You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
To run inference over large amounts of data, you can use batch endpoints to deploy models, including OpenAI models. In this article, you see how to create a batch endpoint to deploy an ADA-002 model from OpenAI to compute embeddings at scale. You can use the same approach for completions and chat completions models.
22
22
23
-
The example in this article uses Microsoft Entra authentication to grant access to an Azure OpenAI Service resource. The model is registered in MLflow format. It uses the OpenAI flavor, which provides support for calling the OpenAI service at scale.
23
+
The example in this article uses Microsoft Entra authentication to grant access to an Azure OpenAI Service resource, but you can also use an access key. The model is registered in MLflow format. It uses the OpenAI flavor, which provides support for calling the OpenAI service at scale.
24
24
25
25
To follow along with the example steps, see the Jupyter notebook [Score OpenAI models in batch using Batch Endpoints](https://github.com/Azure/azureml-examples/blob/main/sdk/python/endpoints/batch/deploy-models/openai-embeddings/deploy-and-test.ipynb).
26
26
@@ -120,7 +120,7 @@ You can configure the identity of the compute cluster to have access to the Azur
120
120
RESOURCE_ID=$(az group show -g $RG --query "id" -o tsv)
121
121
```
122
122
123
-
1. Assign the **Cognitive Services User** role to the managed identity:
123
+
1. Assign the Cognitive Services User role to the managed identity:
124
124
125
125
```azurecli
126
126
az role assignment create --role "Cognitive Services User" --assignee $PRINCIPAL_ID --scope $RESOURCE_ID
@@ -156,7 +156,7 @@ To deploy the OpenAI model, you need to create an endpoint, an environment, a sc
156
156
157
157
### Create an endpoint
158
158
159
-
An endpoint is needed to host the model. Take the following steps to create an endpoint:
159
+
An endpoint is needed to host the model. To create an endpoint, take the following steps:
160
160
161
161
1. Set up a variable to store your endpoint name. Replace the name in the following code with one that's unique within the region of your resource group.
162
162
@@ -293,7 +293,7 @@ To use an access key instead of Microsoft Entra authentication, you use the foll
293
293
294
294
## Test the deployment
295
295
296
-
For testing the endpoint, you use a sample of the dataset [BillSum: A Corpus for Automatic Summarization of US Legislation](https://arxiv.org/abs/1910.00523). This sample is included in the *data* folder of cloned repository.
296
+
For testing the endpoint, you use a sample of the dataset [BillSum: A Corpus for Automatic Summarization of US Legislation](https://arxiv.org/abs/1910.00523). This sample is included in the *data* folder of the cloned repository.
Copy file name to clipboardExpand all lines: articles/machine-learning/includes/azureml-batch-prereqs.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,8 +9,8 @@ ms.author: cacrest
9
9
- An Azure subscription. If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/?WT.mc_id=A261C142F) before you begin.
10
10
- An Azure Machine Learning workspace. To create a workspace, see [Manage Azure Machine Learning workspaces](../how-to-manage-workspace.md).
11
11
- The following permissions in the Azure Machine Learning workspace:
12
-
- For creating or managing batch endpoints and deployments: Use an Owner, Contributor, or Custom role that has been assigned the `Microsoft.MachineLearningServices/workspaces/batchEndpoints/*` actions.
13
-
- For creating Azure Resource Manager deployments in the workspace resource group: Use an Owner, Contributor, or Custom role that has been assigned the `Microsoft.Resources/deployments/write` action in the resource group where the workspace is deployed.
12
+
- For creating or managing batch endpoints and deployments: Use an Owner, Contributor, or custom role that has been assigned the `Microsoft.MachineLearningServices/workspaces/batchEndpoints/*` actions.
13
+
- For creating Azure Resource Manager deployments in the workspace resource group: Use an Owner, Contributor, or custom role that has been assigned the `Microsoft.Resources/deployments/write` action in the resource group where the workspace is deployed.
14
14
- The Azure Machine Learning CLI or the Azure Machine Learning SDK for Python:
15
15
16
16
# [Azure CLI](#tab/cli)
@@ -41,7 +41,7 @@ The workspace is the top-level resource for Azure Machine Learning. It provides
41
41
42
42
# [Azure CLI](#tab/cli)
43
43
44
-
In the following command, enter the values for your subscription ID, workspace, location, and resource group:
44
+
In the following command, enter your subscription ID, workspace name, resource group name, and location:
45
45
46
46
```azurecli
47
47
az account set --subscription <subscription>
@@ -62,7 +62,7 @@ az configure --defaults workspace=<workspace> group=<resource-group> location=<l
62
62
63
63
1. Configure the workspace details and get a handle to the workspace:
64
64
65
-
In the following command, enter the values for your subscription ID, workspace, and resource group:
65
+
In the following command, enter your subscription ID, resource group name, and workspace name:
0 commit comments