Skip to content

Commit 07f901c

Browse files
committed
incorp feedback
1 parent 65e740a commit 07f901c

File tree

1 file changed

+23
-12
lines changed

1 file changed

+23
-12
lines changed

articles/aks/ai-toolchain-operator.md

Lines changed: 23 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ title: Deploy an AI model on Azure Kubernetes Service (AKS) with the AI toolchai
33
description: Learn how to enable the AI toolchain operator add-on on Azure Kubernetes Service (AKS) to simplify OSS AI model management and deployment.
44
ms.topic: article
55
ms.custom: azure-kubernetes-service
6-
ms.date: 01/30/2024
6+
ms.date: 02/28/2024
77
---
88

99
# Deploy an AI model on Azure Kubernetes Service (AKS) with the AI toolchain operator (preview)
@@ -22,7 +22,7 @@ This article shows you how to enable the AI toolchain operator add-on and deploy
2222
## Prerequisites
2323

2424
* If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/?WT.mc_id=A261C142F) before you begin.
25-
* If you have multiple Azure subscriptions, make sure you select the correct subscription in which the resources will be created and charged using the [`az account set`][az-account-set] command.
25+
* If you have multiple Azure subscriptions, make sure you select the correct subscription in which the resources will be created and charged using the [az account set][az-account-set] command.
2626

2727
> [!NOTE]
2828
> The subscription you use must have GPU VM quota.
@@ -34,29 +34,29 @@ This article shows you how to enable the AI toolchain operator add-on and deploy
3434

3535
### Install the Azure CLI preview extension
3636

37-
1. Install the Azure CLI preview extension using the [`az extension add`][az-extension-add] command.
37+
1. Install the Azure CLI preview extension using the [az extension add][az-extension-add] command.
3838

3939
```azurecli-interactive
4040
az extension add --name aks-preview
4141
```
4242
43-
2. Update the extension to make sure you have the latest version using the [`az extension update`][az-extension-update] command.
43+
2. Update the extension to make sure you have the latest version using the [az extension update][az-extension-update] command.
4444
4545
```azurecli-interactive
4646
az extension update --name aks-preview
4747
```
4848
4949
### Register the AI toolchain operator add-on feature flag
5050
51-
1. Register the AIToolchainOperatorPreview feature flag using the [`az feature register`][az-feature-register] command.
51+
1. Register the AIToolchainOperatorPreview feature flag using the [az feature register][az-feature-register] command.
5252
5353
```azurecli-interactive
5454
az feature register --namespace "Microsoft.ContainerService" --name "AIToolchainOperatorPreview"
5555
```
5656
5757
It takes a few minutes for the registration to complete.
5858
59-
2. Verify the registration using the [`az feature show`][az-feature-show] command.
59+
2. Verify the registration using the [az feature show][az-feature-show] command.
6060
6161
```azurecli-interactive
6262
az feature show --namespace "Microsoft.ContainerService" --name "AIToolchainOperatorPreview"
@@ -79,13 +79,13 @@ The following sections describe how to create an AKS cluster with the AI toolcha
7979
8080
### Create an AKS cluster with the AI toolchain operator add-on enabled
8181
82-
1. Create an Azure resource group using the [`az group create`][az-group-create] command.
82+
1. Create an Azure resource group using the [az group create][az-group-create] command.
8383
8484
```azurecli-interactive
8585
az group create --name ${AZURE_RESOURCE_GROUP} --location ${AZURE_LOCATION}
8686
```
8787
88-
2. Create an AKS cluster with the AI toolchain operator add-on enabled using the [`az aks create`][az-aks-create] command with the `--enable-ai-toolchain-operator` and `--enable-oidc-issuer` flags.
88+
2. Create an AKS cluster with the AI toolchain operator add-on enabled using the [az aks create][az-aks-create] command with the `--enable-managed-identity`, `--enable-ai-toolchain-operator`, and `--enable-oidc-issuer` flags.
8989
9090
```azurecli-interactive
9191
az aks create --location ${AZURE_LOCATION} \
@@ -101,9 +101,19 @@ The following sections describe how to create an AKS cluster with the AI toolcha
101101
>
102102
> AI toolchain operator enablement requires the enablement of OIDC issuer.
103103
104+
3. On an existing AKS cluster, you can enable the AI toolchain operator add-on using the [az aks update][az-aks-update] command.
105+
106+
```azurecli-interactive
107+
az aks update --name ${CLUSTER_NAME} \
108+
--resource-group ${AZURE_RESOURCE_GROUP} \
109+
--enable-managed-identity \
110+
--enable-oidc-issuer \
111+
--enable-ai-toolchain-operator
112+
```
113+
104114
## Connect to your cluster
105115
106-
1. Configure `kubectl` to connect to your cluster using the [`az aks get-credentials`][az-aks-get-credentials] command.
116+
1. Configure `kubectl` to connect to your cluster using the [az aks get-credentials][az-aks-get-credentials] command.
107117
108118
```azurecli-interactive
109119
az aks get-credentials --resource-group ${AZURE_RESOURCE_GROUP} --name ${CLUSTER_NAME}
@@ -142,7 +152,7 @@ The following sections describe how to create an AKS cluster with the AI toolcha
142152
143153
## Create role assignment for the service principal
144154
145-
* Create a new role assignment for the service principal using the [`az role assignment create`][az-role-assignment-create] command.
155+
* Create a new role assignment for the service principal using the [az role assignment create][az-role-assignment-create] command.
146156
147157
```azurecli-interactive
148158
az role assignment create --role "Contributor" \
@@ -152,7 +162,7 @@ The following sections describe how to create an AKS cluster with the AI toolcha
152162
153163
## Establish a federated identity credential
154164
155-
* Create the federated identity credential between the managed identity, AKS OIDC issuer, and subject using the [`az identity federated-credential create`][az-identity-federated-credential-create] command.
165+
* Create the federated identity credential between the managed identity, AKS OIDC issuer, and subject using the [az identity federated-credential create][az-identity-federated-credential-create] command.
156166
157167
```azurecli-interactive
158168
az identity federated-credential create --name "kaito-federated-identity" \
@@ -210,7 +220,7 @@ The following sections describe how to create an AKS cluster with the AI toolcha
210220
211221
If you no longer need these resources, you can delete them to avoid incurring extra Azure charges.
212222
213-
* Delete the resource group and its associated resources using the [`az group delete`][az-group-delete] command.
223+
* Delete the resource group and its associated resources using the [az group delete][az-group-delete] command.
214224
215225
```azurecli-interactive
216226
az group delete --name "${AZURE_RESOURCE_GROUP}" --yes --no-wait
@@ -224,6 +234,7 @@ For more inference model options, see the [KAITO GitHub repository](https://gith
224234
[az-group-create]: /cli/azure/group#az_group_create
225235
[az-group-delete]: /cli/azure/group#az_group_delete
226236
[az-aks-create]: /cli/azure/aks#az_aks_create
237+
[az-aks-update]: /cli/azure/aks#az_aks_update
227238
[az-aks-get-credentials]: /cli/azure/aks#az_aks_get_credentials
228239
[az-role-assignment-create]: /cli/azure/role/assignment#az_role_assignment_create
229240
[az-identity-federated-credential-create]: /cli/azure/identity/federated-credential#az_identity_federated_credential_create

0 commit comments

Comments
 (0)