Skip to content

Commit 4352371

Browse files
schaffererinschaffererin
committed
New scenario doc: Deploy data and ML pipelines on AKS with Flyte
1 parent baa5e21 commit 4352371

File tree

2 files changed

+116
-4
lines changed

2 files changed

+116
-4
lines changed

‎articles/aks/TOC.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -846,6 +846,8 @@
846846
href: open-ai-secure-access-quickstart.md
847847
- name: Deploy an AI model with the AI toolchain operator
848848
href: ai-toolchain-operator.md
849+
- name: Deploy data and ML pipelines with Flyte
850+
href: use-flyte.md
849851
- name: DevOps
850852
items:
851853
- name: Azure DevOps Project

‎articles/aks/use-flyte.md

Lines changed: 114 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ author: schaffererin
88
ms.author: schaffererin
99
---
1010

11-
# Build and deploy data and machine learning pipelines with Flyte on Azure Kubernetes Service
11+
# Build and deploy data and machine learning pipelines with Flyte on Azure Kubernetes Service (AKS)
1212

1313
This article shows you how to use Flyte, an open-source platform for building and deploying data and machine learning pipelines on Azure Kubernetes Service (AKS).
1414

@@ -18,9 +18,119 @@ For more information, see [Introduction to Flyte](https://docs.flyte.org/en/late
1818

1919
## Prerequisites
2020

21-
* Helm
22-
* Azure subscription
23-
* Etc.
21+
* An Azure subscription. If you don't have an Azure subscription, you can create a [free account](https://azure.microsoft.com/free).
22+
* The Azure CLI installed and configured. Run `az --version` to check the version. If you need to install or upgrade, see [Install the Azure CLI](https://docs.microsoft.com/cli/azure/install-azure-cli).
23+
* The Helm CLI installed and updated. Run `helm version` to check the version. If you need to install or upgrade, see [Install Helm](https://helm.sh/docs/intro/install/).
24+
* The `kubectl` CLI installed and updated. Run `az aks install-cli` to install it locally or see [Install kubectl](https://kubernetes.io/docs/tasks/tools/install-kubectl/).
25+
26+
> [!NOTE]
27+
> If you're using the Azure Cloud Shell, the Azure CLI, Helm, and kubectl are already installed.
28+
29+
### Set environment variables
30+
31+
* Set environment variables for use throughout the article. Replace the placeholder values with your own values.
32+
33+
```bash
34+
export RESOURCE_GROUP="<resource-group-name>"
35+
export LOCATION="<location>"
36+
export CLUSTER_NAME="<cluster-name>"
37+
export DNS_NAME_PREFIX="<dns-name-prefix>"
38+
```
2439

2540
## Create an AKS cluster
2641

42+
1. Create an Azure resource group for the AKS cluster using the [`az group create`][az-group-create] command.
43+
44+
```azurecli-interactive
45+
az group create --name $RESOURCE_GROUP --location $LOCATION
46+
```
47+
48+
2. Create an AKS cluster using the [`az aks create`][az-aks-create] command with the `--enable-azure-rbac`, `--enable-managed-identity`, `--enable-aad`, and `--dns-name-prefix` parameters.
49+
50+
```azurecli-interactive
51+
az aks create --resource-group $RESOURCE_GROUP --name $CLUSTER_NAME --enable-azure-rbac --enable-managed-identity --enable-aad --dns-name-prefix $DNS_NAME_PREFIX --generate-ssh-keys
52+
```
53+
54+
## Connect to your AKS cluster
55+
56+
* Configure `kubectl` to connect to your AKS cluster using the [`az aks get-credentials`][az-aks-get-credentials] command.
57+
58+
```azurecli-interactive
59+
az aks get-credentials --resource-group $RESOURCE_GROUP --name $CLUSTER_NAME
60+
```
61+
62+
## Add the Flyte Helm repository
63+
64+
* Add the Flyte Helm repository using the `helm repo add` command.
65+
66+
```bash
67+
helm repo add flyteorg https://flyteorg.github.io/flyte
68+
```
69+
70+
## Find Flyte Helm charts
71+
72+
1. Search for Flyte Helm charts using the `helm search repo` command.
73+
74+
```bash
75+
helm search repo flyteorg
76+
```
77+
78+
The following example output shows some of the available Flyte Helm charts:
79+
80+
```output
81+
NAME CHART VERSION APP VERSION DESCRIPTION
82+
flyteorg/flyte v1.12.0 A Helm chart for Flyte Sandbox
83+
flyteorg/flyte-binary v1.12.0 1.16.0 Chart for basic single Flyte executable deployment
84+
flyteorg/flyte-core v1.12.0 A Helm chart for Flyte core
85+
flyteorg/flyte-deps v1.12.0 A Helm chart for Flyte dependencies
86+
flyteorg/flyte-sandbox 0.1.0 1.16.1 A Helm chart for the Flyte local sandbox
87+
flyteorg/flyteagent v0.1.10 A Helm chart for Flyte Agent
88+
```
89+
90+
2. Update the repository using the `helm repo update` command.
91+
92+
```bash
93+
helm repo update
94+
```
95+
96+
## Deploy a Flyte chart on AKS
97+
98+
1. Create a namespace for your Flyte deployment using the `kubectl create namespace` command.
99+
100+
```bash
101+
kubectl create namespace <namespace-name>
102+
```
103+
104+
2. Install a Flyte Helm chart using the `helm install` command. In this example, we use the `flyte-binary` chart.
105+
106+
```bash
107+
helm install flyte-binary flyteorg/flyte-core --namespace <namespace-name>
108+
```
109+
110+
3. Verify that the Flyte deployment is running using the `kubectl get services` command.
111+
112+
```bash
113+
kubectl get services --namespace <namespace-name> --output wide
114+
```
115+
116+
The following condensed example output shows the Flyte deployment:
117+
118+
```output
119+
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
120+
flyteorg-flyte-binary-grpc ClusterIP xx.x.xx.xxx <none> 81/TCP 1m
121+
flyteorg-flyte-binary-http ClusterIP xx.x.xx.xxx <none> 80/TCP 1m
122+
flyteorg-flyte-binary-webhook ClusterIP xx.x.xx.xxx <none> 80/TCP 1m
123+
```
124+
125+
## Next steps
126+
127+
In this article, you learned how to deploy a Flyte chart on AKS. To learn more about deployments on AKS, see the following articles:
128+
129+
* [Deploy an application that uses OpenAI on Azure Kubernetes Service (AKS)](./open-ai-quickstart.md)
130+
* [Install existing applications with Helm on Azure Kubernetes Service (AKS)](./kubernetes-helm.md)
131+
* [Deploy a containerized application to Azure Kubernetes Service (AKS)](./tutorial-kubernetes-deploy-application.md
132+
133+
<!-- LINKS -->
134+
[az-group-create]: /cli/azure/group#az-group-create
135+
[az-aks-create]: /cli/azure/aks#az-aks-create
136+
[az-aks-get-credentials]: /cli/azure/aks#az-aks-get-credentials

0 commit comments

Comments
 (0)