-
Notifications
You must be signed in to change notification settings - Fork 8
Data Platform | Add dedicated K8s page and detailed descriptions (architecture/components) #814
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
nerpaula
wants to merge
5
commits into
DOC-761
Choose a base branch
from
data-platform-misc
base: DOC-761
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+191
−46
Open
Changes from 4 commits
Commits
Show all changes
5 commits
Select commit
Hold shift + click to select a range
67c20df
data platform for amp is available upon request
nerpaula e7b5976
Add new Kubernetes page; Add detailed descriptions of Data Platform's…
nerpaula 8507f86
Apply suggestions from code review
nerpaula aa51378
apply review suggestions
nerpaula b65946e
Apply suggestion from @nerpaula
nerpaula File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -21,6 +21,52 @@ AI solutions for GraphRAG, graph machine learning, data explorations, and more. | |
| run it on-premises or in the cloud yourself on top of Kubernetes to access all | ||
| of the platform features with enterprise-grade automation and reliability. | ||
|
|
||
| ## What Makes Up the Arango Data Platform | ||
|
|
||
| The Arango Data Platform is built on a layered architecture that combines powerful | ||
| components into a unified solution: | ||
|
|
||
| - **ArangoDB Enterprise Edition**: The multi-model database foundation supporting | ||
| graphs, documents, key-value, vector search, and full-text search capabilities. | ||
|
|
||
| - **Graph Visualizer**: A sophisticated web-based interface for graph exploration, | ||
| smart search, and visual layouts. | ||
|
|
||
| - **Arango Platform Suite**: Enterprise-grade features including high availability | ||
| and monitoring, the Graph Analytics Engine, comprehensive APIs and connectors, | ||
| and centralized orchestration and resource management. | ||
|
|
||
| All components are orchestrated through Kubernetes, providing automated deployment, | ||
| scaling, and management with enterprise-grade reliability. | ||
|
|
||
| For a detailed breakdown of each component, see [Features and Architecture](features/). | ||
|
|
||
| ## Extend the Arango Data Platform with AI capabilities | ||
|
|
||
| Extend the Arango Data Platform with the [**AI Suite**](../ai-suite/_index.md) | ||
| that offers advanced AI and machine learning capabilities that integrate seamlessly | ||
| into the platform's unified web interface. | ||
|
|
||
| What you get with the AI Suite: | ||
|
|
||
| - [GraphRAG](../ai-suite/graphrag/): Generate knowledge graphs from documents and enable | ||
| conversational querying of your data. | ||
| - [GraphML](../ai-suite/graphml/): Apply machine learning algorithms that leverage graph | ||
| structure for better predictions. | ||
| - [Graph Analytics](../ai-suite/graph-analytics/): Run advanced algorithms like PageRank | ||
| to discover influential nodes and patterns. | ||
| - [Jupyter notebooks](../ai-suite/notebook-servers.md): Run Jupyter Notebooks to build and | ||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. AQLizer! |
||
| experiment with graph-powered data, AI, and machine learning workflows directly connected | ||
| to ArangoDB databases. | ||
| - Public and private LLM support: Use public LLMs such as OpenAI | ||
| or private LLMs with [Triton Inference Server](../ai-suite/reference/triton-inference-server.md). | ||
| - [MLflow integration](../ai-suite/reference/mlflow.md): Use the popular MLflow as a model registry | ||
| for private LLMs or to run machine learning experiments as part of the Arango Data Platform. | ||
|
|
||
| {{< tip >}} | ||
| The AI Suite requires a separate license. | ||
| {{< /tip >}} | ||
|
|
||
| {{< cards >}} | ||
|
|
||
| {{% card title="Get started with the Arango Data Platform" link="get-started/" %}} | ||
|
|
@@ -32,8 +78,8 @@ Optionally add AI Suite to turn data into an AI-powered knowledge engine. | |
| Explore the Kubernetes-native architecture, unified interface, and enterprise-grade capabilities of the Arango Data Platform. | ||
| {{% /card %}} | ||
|
|
||
| {{% card title="ArangoDB Kubernetes Operator" link="../../arangodb/3.12/deploy/kubernetes/" %}} | ||
| Learn about the official ArangoDB Kubernetes Operator that powers the Arango Data Platform. | ||
| {{% card title="Kubernetes-Native Architecture" link="kubernetes/" %}} | ||
| Learn about the Kubernetes-native foundation that the Arango Data Platform is purpose-built on. | ||
| {{% /card %}} | ||
|
|
||
| {{% card title="Graph Visualizer" link="graph-visualizer/" %}} | ||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,81 @@ | ||
| --- | ||
| title: Kubernetes-Native Architecture | ||
| menuTitle: Kubernetes | ||
| weight: 15 | ||
| description: >- | ||
| The Arango Data Platform is purpose-built for Kubernetes, leveraging | ||
| container orchestration for automated deployment, scaling, and management | ||
| --- | ||
| The Arango Data Platform is **Kubernetes-native** by design, meaning it is built | ||
| from the ground up to run on [Kubernetes](https://kubernetes.io/) and requires | ||
| it to function. This is not an optional feature, Kubernetes is the foundation | ||
| that powers the entire platform architecture. | ||
|
|
||
| {{< info >}} | ||
| **Kubernetes Required**: The Arango Data Platform cannot operate without Kubernetes. | ||
| It relies on Kubernetes orchestration and the | ||
| [ArangoDB Kubernetes Operator](https://arangodb.github.io/kube-arangodb/) for | ||
| all deployment, scaling, and management operations. | ||
| {{< /info >}} | ||
|
|
||
| ## Why Kubernetes? | ||
|
|
||
| By building exclusively on Kubernetes, the Arango Data Platform delivers | ||
| enterprise-grade capabilities that would be difficult or impossible to achieve | ||
| with traditional deployment approaches: | ||
|
|
||
| - **Automated Management and Self-Healing**: Kubernetes handles deployment, | ||
| scaling, node failures, and rolling updates automatically, with self-healing | ||
| capabilities that restart failed containers and maintain high availability | ||
| without manual intervention. | ||
|
|
||
| - **Dynamic Scalability and Resource Optimization**: Scale your database cluster | ||
| up or down based on workload demands, with efficient resource allocation and | ||
| scheduling ensuring optimal utilization of CPU, memory, and storage. | ||
|
Comment on lines
+32
to
+34
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Any limitations with regard to downscaling? |
||
|
|
||
| - **Declarative Configuration and Zero-Downtime Updates**: Define your desired | ||
| state using Kubernetes manifests and deploy updates with zero downtime through | ||
| controlled rolling updates and easy rollback capabilities. | ||
|
|
||
| - **Cloud and On-Premises Flexibility**: Run on any Kubernetes-compatible | ||
| environment—public cloud providers (AWS, Azure, GCP), private cloud, or | ||
| on-premises infrastructure—with consistent deployment across all environments. | ||
|
|
||
| ## The ArangoDB Kubernetes Operator | ||
|
|
||
| The Arango Data Platform is powered by the official | ||
| [ArangoDB Kubernetes Operator](https://arangodb.github.io/kube-arangodb/) | ||
| (`kube-arangodb`), which provides the following features: | ||
|
|
||
| - **Custom Resource Definitions (CRDs)**: Extend Kubernetes with ArangoDB-specific | ||
| resources like `ArangoDeployment`, `ArangoBackup`, and more. | ||
|
|
||
| - **Intelligent Orchestration**: The operator understands ArangoDB's architecture | ||
| and requirements, ensuring deployments follow best practices automatically. | ||
|
|
||
| - **Backup and Restore**: Automated backup management integrated directly into | ||
| the Kubernetes workflow. | ||
|
|
||
| - **High Availability**: Built-in support for multi-datacenter replication, | ||
| automatic failover, and disaster recovery scenarios. | ||
|
|
||
| - **Enterprise Features**: Full support for ArangoDB Enterprise Edition features | ||
| including encryption, auditing, and advanced security controls. | ||
|
|
||
| For detailed information about the operator, see the | ||
| [ArangoDB Kubernetes Operator documentation](https://arangodb.github.io/kube-arangodb/docs/). | ||
|
|
||
| ## Platform Services as Kubernetes Resources | ||
|
|
||
| All components of the Arango Data Platform, from the core database to the optional | ||
| AI Suite, are deployed and managed as native Kubernetes resources. This | ||
| means you can do the following: | ||
|
|
||
| - Use standard Kubernetes tools (`kubectl`, Helm, etc.) to manage your deployment | ||
| - Monitor platform health using Kubernetes-native observability tools | ||
| - Integrate with existing Kubernetes infrastructure and workflows | ||
| - Apply your organization's Kubernetes policies and security controls | ||
|
|
||
| This Kubernetes-native approach ensures the Arango Data Platform fits naturally | ||
| into modern cloud-native environments and DevOps practices. | ||
|
|
||
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Graph analytics → Part of AI Suite in the October release isn't it?