You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/aks/ai-toolchain-operator.md
+23-12Lines changed: 23 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@ title: Deploy an AI model on Azure Kubernetes Service (AKS) with the AI toolchai
3
3
description: Learn how to enable the AI toolchain operator add-on on Azure Kubernetes Service (AKS) to simplify OSS AI model management and deployment.
4
4
ms.topic: article
5
5
ms.custom: azure-kubernetes-service
6
-
ms.date: 01/30/2024
6
+
ms.date: 02/28/2024
7
7
---
8
8
9
9
# Deploy an AI model on Azure Kubernetes Service (AKS) with the AI toolchain operator (preview)
@@ -22,7 +22,7 @@ This article shows you how to enable the AI toolchain operator add-on and deploy
22
22
## Prerequisites
23
23
24
24
* If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/?WT.mc_id=A261C142F) before you begin.
25
-
* If you have multiple Azure subscriptions, make sure you select the correct subscription in which the resources will be created and charged using the [`az account set`][az-account-set] command.
25
+
* If you have multiple Azure subscriptions, make sure you select the correct subscription in which the resources will be created and charged using the [az account set][az-account-set] command.
26
26
27
27
> [!NOTE]
28
28
> The subscription you use must have GPU VM quota.
@@ -34,29 +34,29 @@ This article shows you how to enable the AI toolchain operator add-on and deploy
34
34
35
35
### Install the Azure CLI preview extension
36
36
37
-
1. Install the Azure CLI preview extension using the [`az extension add`][az-extension-add] command.
37
+
1. Install the Azure CLI preview extension using the [az extension add][az-extension-add] command.
38
38
39
39
```azurecli-interactive
40
40
az extension add --name aks-preview
41
41
```
42
42
43
-
2. Update the extension to make sure you have the latest version using the [`az extension update`][az-extension-update] command.
43
+
2. Update the extension to make sure you have the latest version using the [az extension update][az-extension-update] command.
44
44
45
45
```azurecli-interactive
46
46
az extension update --name aks-preview
47
47
```
48
48
49
49
### Register the AI toolchain operator add-on feature flag
50
50
51
-
1. Register the AIToolchainOperatorPreview feature flag using the [`az feature register`][az-feature-register] command.
51
+
1. Register the AIToolchainOperatorPreview feature flag using the [az feature register][az-feature-register] command.
52
52
53
53
```azurecli-interactive
54
54
az feature register --namespace "Microsoft.ContainerService" --name "AIToolchainOperatorPreview"
55
55
```
56
56
57
57
It takes a few minutes for the registration to complete.
58
58
59
-
2. Verify the registration using the [`az feature show`][az-feature-show] command.
59
+
2. Verify the registration using the [az feature show][az-feature-show] command.
60
60
61
61
```azurecli-interactive
62
62
az feature show --namespace "Microsoft.ContainerService" --name "AIToolchainOperatorPreview"
@@ -79,13 +79,13 @@ The following sections describe how to create an AKS cluster with the AI toolcha
79
79
80
80
### Create an AKS cluster with the AI toolchain operator add-on enabled
81
81
82
-
1. Create an Azure resource group using the [`az group create`][az-group-create] command.
82
+
1. Create an Azure resource group using the [az group create][az-group-create] command.
83
83
84
84
```azurecli-interactive
85
85
az group create --name ${AZURE_RESOURCE_GROUP} --location ${AZURE_LOCATION}
86
86
```
87
87
88
-
2. Create an AKS cluster with the AI toolchain operator add-on enabled using the [`az aks create`][az-aks-create] command with the `--enable-ai-toolchain-operator` and `--enable-oidc-issuer` flags.
88
+
2. Create an AKS cluster with the AI toolchain operator add-on enabled using the [az aks create][az-aks-create] command with the `--enable-managed-identity`, `--enable-ai-toolchain-operator`, and `--enable-oidc-issuer` flags.
89
89
90
90
```azurecli-interactive
91
91
az aks create --location ${AZURE_LOCATION} \
@@ -101,9 +101,19 @@ The following sections describe how to create an AKS cluster with the AI toolcha
101
101
>
102
102
> AI toolchain operator enablement requires the enablement of OIDC issuer.
103
103
104
+
3. On an existing AKS cluster, you can enable the AI toolchain operator add-on using the [az aks update][az-aks-update] command.
105
+
106
+
```azurecli-interactive
107
+
az aks update --name ${CLUSTER_NAME} \
108
+
--resource-group ${AZURE_RESOURCE_GROUP} \
109
+
--enable-managed-identity \
110
+
--enable-oidc-issuer \
111
+
--enable-ai-toolchain-operator
112
+
```
113
+
104
114
## Connect to your cluster
105
115
106
-
1. Configure `kubectl` to connect to your cluster using the [`az aks get-credentials`][az-aks-get-credentials] command.
116
+
1. Configure `kubectl` to connect to your cluster using the [az aks get-credentials][az-aks-get-credentials] command.
107
117
108
118
```azurecli-interactive
109
119
az aks get-credentials --resource-group ${AZURE_RESOURCE_GROUP} --name ${CLUSTER_NAME}
@@ -142,7 +152,7 @@ The following sections describe how to create an AKS cluster with the AI toolcha
142
152
143
153
## Create role assignment for the service principal
144
154
145
-
* Create a new role assignment for the service principal using the [`az role assignment create`][az-role-assignment-create] command.
155
+
* Create a new role assignment for the service principal using the [az role assignment create][az-role-assignment-create] command.
146
156
147
157
```azurecli-interactive
148
158
az role assignment create --role "Contributor" \
@@ -152,7 +162,7 @@ The following sections describe how to create an AKS cluster with the AI toolcha
152
162
153
163
## Establish a federated identity credential
154
164
155
-
* Create the federated identity credential between the managed identity, AKS OIDC issuer, and subject using the [`az identity federated-credential create`][az-identity-federated-credential-create] command.
165
+
* Create the federated identity credential between the managed identity, AKS OIDC issuer, and subject using the [az identity federated-credential create][az-identity-federated-credential-create] command.
156
166
157
167
```azurecli-interactive
158
168
az identity federated-credential create --name "kaito-federated-identity" \
@@ -210,7 +220,7 @@ The following sections describe how to create an AKS cluster with the AI toolcha
210
220
211
221
If you no longer need these resources, you can delete them to avoid incurring extra Azure charges.
212
222
213
-
* Delete the resource group and its associated resources using the [`az group delete`][az-group-delete] command.
223
+
* Delete the resource group and its associated resources using the [az group delete][az-group-delete] command.
214
224
215
225
```azurecli-interactive
216
226
az group delete --name "${AZURE_RESOURCE_GROUP}" --yes --no-wait
@@ -224,6 +234,7 @@ For more inference model options, see the [KAITO GitHub repository](https://gith
0 commit comments