You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* Azure role-based access control (Azure RBAC) is used to grant access to operations in Azure Machine Learning. To perform the steps in this article, your user account must be assigned the Owner or Contributor role for the Azure Machine Learning workspace, or a custom role must allow `Microsoft.MachineLearningServices/workspaces/onlineEndpoints/*`. If you use Azure Machine Learning studio to create and manage online endpoints or deployments, you need the extra permission `Microsoft.Resources/deployments/write` from the resource group owner. For more information, see [Manage access to Azure Machine Learning workspaces](how-to-assign-roles.md).
37
+
37
38
* (Optional) To deploy locally, you must [install Docker Engine](https://docs.docker.com/engine/install/) on your local computer. We *highly recommend* this option, which makes it easier to debug issues.
38
39
39
40
# [Python SDK](#tab/python)
@@ -43,6 +44,7 @@ The main example in this article uses managed online endpoints for deployment. T
* Azure RBAC is used to grant access to operations in Azure Machine Learning. To perform the steps in this article, your user account must be assigned the Owner or Contributor role for the Azure Machine Learning workspace, or a custom role must allow `Microsoft.MachineLearningServices/workspaces/onlineEndpoints/*`. For more information, see [Manage access to Azure Machine Learning workspaces](how-to-assign-roles.md).
47
+
46
48
* (Optional) To deploy locally, you must [install Docker Engine](https://docs.docker.com/engine/install/) on your local computer. We *highly recommend* this option, which makes it easier to debug issues.
47
49
48
50
# [Studio](#tab/azure-studio)
@@ -55,15 +57,16 @@ Before you follow the steps in this article, make sure that you have the followi
55
57
56
58
# [ARM template](#tab/arm)
57
59
58
-
The Azure CLI and CLI extension for machine learning are used in these steps, but they're not the main focus. They're used more as utilities to pass templates to Azure and check the status of template deployments.
60
+
The Azure CLI and the CLI extension for machine learning are used in these steps, but they're not the main focus. They're used more as utilities to pass templates to Azure and check the status of template deployments.
* Azure RBAC is used to grant access to operations in Azure Machine Learning. To perform the steps in this article, your user account must be assigned the Owner or Contributor role for the Azure Machine Learning workspace, or a custom role must allow `Microsoft.MachineLearningServices/workspaces/onlineEndpoints/*`. For more information, see [Manage access to an Azure Machine Learning workspace](how-to-assign-roles.md).
63
65
64
66
---
65
67
66
-
* Ensure that you have enough virtual machine (VM) quota allocated for deployment. Azure Machine Learning reserves 20% of your compute resources for performing upgrades on some VM versions. For example, if you request 10 instances in a deployment, you must have a quota of 12 for each number of cores for the VM version. Failure to account for the extra compute resources results in an error. There are some VM versions that are exempt from the extra quota reservation. For more information on quota allocation, see [Virtual machine quota allocation for deployment](how-to-manage-quotas.md#virtual-machine-quota-allocation-for-deployment).
68
+
* Ensure that you have enough virtual machine (VM) quota allocated for deployment. Azure Machine Learning reserves 20% of your compute resources for performing upgrades on some VM versions. For example, if you request 10 instances in a deployment, you must have a quota of 12 for each number of cores for the VM version. Failure to account for the extra compute resources results in an error. Some VM versions are exempt from the extra quota reservation. For more information on quota allocation, see [Virtual machine quota allocation for deployment](how-to-manage-quotas.md#virtual-machine-quota-allocation-for-deployment).
69
+
67
70
* Alternatively, you could use quota from the Azure Machine Learning shared quota pool for a limited time. [!INCLUDE [machine-learning-shared-quota](includes/machine-learning-shared-quota.md)]
68
71
69
72
## Prepare your system
@@ -156,7 +159,7 @@ If you have Git installed on your local machine, you can follow the instructions
156
159
157
160
### Clone the examples repository
158
161
159
-
To follow along with this article, first clone the [azureml-examples repository](https://github.com/azure/azureml-examples), then change into the *azureml-examples/cli/endpoints/online/model-1* directory.
162
+
To follow along with this article, first clone the [azureml-examples repository](https://github.com/azure/azureml-examples), andthen change into the *azureml-examples/cli/endpoints/online/model-1* directory.
@@ -282,7 +285,7 @@ To set your endpoint name, run the following command to generate a random name.
282
285
283
286
### Configure the endpoint
284
287
285
-
To define the endpoint and deployment, this article uses Azure Resource Manager templates (ARM templates). The ARM templates that are used are[online-endpoint.json](https://github.com/Azure/azureml-examples/tree/main/arm-templates/online-endpoint.json) and [online-endpoint-deployment.json](https://github.com/Azure/azureml-examples/tree/main/arm-templates/online-endpoint-deployment.json). To use the templates for defining an online endpoint and deployment, see the [Deploy to Azure](#deploy-to-azure) section.
288
+
To define the endpoint and deployment, this article uses the Azure Resource Manager templates (ARM templates) [online-endpoint.json](https://github.com/Azure/azureml-examples/tree/main/arm-templates/online-endpoint.json) and [online-endpoint-deployment.json](https://github.com/Azure/azureml-examples/tree/main/arm-templates/online-endpoint-deployment.json). To use the templates for defining an online endpoint and deployment, see the [Deploy to Azure](#deploy-to-azure) section.
286
289
287
290
---
288
291
@@ -688,7 +691,7 @@ To register the example model, follow these steps:
688
691
689
692
:::image type="content" source="media/how-to-deploy-online-endpoints/register-model-folder.png" alt-text="Screenshot that shows the browse folder option." lightbox="media/how-to-deploy-online-endpoints/register-model-folder.png":::
690
693
691
-
1. Select the *\azureml-examples\cli\endpoints\online\model-1\model* folder from the local copy of the repo that you cloned or downloaded earlier. When prompted, select __Upload__ and wait for the upload to finish.
694
+
1. Select the *\azureml-examples\cli\endpoints\online\model-1\model* folder from the local copy of the repo that you cloned or downloaded earlier. When you're prompted, select __Upload__ and wait for the upload to finish.
692
695
1. Select __Next__.
693
696
1. Enter a friendly name for the model. The steps in this article assume that the model is named `model-1`.
694
697
1. Select __Next__, and then select __Register__ to finish registration.
@@ -1065,9 +1068,9 @@ By default, logs are pulled from the inference server container. To see logs fro
1065
1068
1066
1069
By using the `MLClient` parameter that you created earlier, you get a handle to the endpoint. You can then invoke the endpoint by using the `invoke` command with the following parameters:
1067
1070
1068
-
- `endpoint_name`: Name of the endpoint
1069
-
- `request_file`: File with request data
1070
-
- `deployment_name`: Name of the specific deployment to test in an endpoint
1071
+
- `endpoint_name`: Name of the endpoint.
1072
+
- `request_file`: File with request data.
1073
+
- `deployment_name`: Name of the specific deployment to test in an endpoint.
1071
1074
1072
1075
Send a sample request by using a [JSON](https://github.com/Azure/azureml-examples/blob/main/sdk/python/endpoints/online/model-1/sample-request.json) file.
0 commit comments