Skip to content

Commit b8cd841

Browse files
authored
Update how-to-deploy-online-endpoints.md
1 parent ea4c9d3 commit b8cd841

File tree

1 file changed

+11
-8
lines changed

1 file changed

+11
-8
lines changed

articles/machine-learning/how-to-deploy-online-endpoints.md

Lines changed: 11 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,7 @@ The main example in this article uses managed online endpoints for deployment. T
3434
[!INCLUDE [basic prereqs cli](includes/machine-learning-cli-prereqs.md)]
3535

3636
* Azure role-based access control (Azure RBAC) is used to grant access to operations in Azure Machine Learning. To perform the steps in this article, your user account must be assigned the Owner or Contributor role for the Azure Machine Learning workspace, or a custom role must allow `Microsoft.MachineLearningServices/workspaces/onlineEndpoints/*`. If you use Azure Machine Learning studio to create and manage online endpoints or deployments, you need the extra permission `Microsoft.Resources/deployments/write` from the resource group owner. For more information, see [Manage access to Azure Machine Learning workspaces](how-to-assign-roles.md).
37+
3738
* (Optional) To deploy locally, you must [install Docker Engine](https://docs.docker.com/engine/install/) on your local computer. We *highly recommend* this option, which makes it easier to debug issues.
3839

3940
# [Python SDK](#tab/python)
@@ -43,6 +44,7 @@ The main example in this article uses managed online endpoints for deployment. T
4344
[!INCLUDE [basic prereqs sdk](includes/machine-learning-sdk-v2-prereqs.md)]
4445

4546
* Azure RBAC is used to grant access to operations in Azure Machine Learning. To perform the steps in this article, your user account must be assigned the Owner or Contributor role for the Azure Machine Learning workspace, or a custom role must allow `Microsoft.MachineLearningServices/workspaces/onlineEndpoints/*`. For more information, see [Manage access to Azure Machine Learning workspaces](how-to-assign-roles.md).
47+
4648
* (Optional) To deploy locally, you must [install Docker Engine](https://docs.docker.com/engine/install/) on your local computer. We *highly recommend* this option, which makes it easier to debug issues.
4749

4850
# [Studio](#tab/azure-studio)
@@ -55,15 +57,16 @@ Before you follow the steps in this article, make sure that you have the followi
5557

5658
# [ARM template](#tab/arm)
5759

58-
The Azure CLI and CLI extension for machine learning are used in these steps, but they're not the main focus. They're used more as utilities to pass templates to Azure and check the status of template deployments.
60+
The Azure CLI and the CLI extension for machine learning are used in these steps, but they're not the main focus. They're used more as utilities to pass templates to Azure and check the status of template deployments.
5961

6062
[!INCLUDE [basic prereqs cli](includes/machine-learning-cli-prereqs.md)]
6163

6264
* Azure RBAC is used to grant access to operations in Azure Machine Learning. To perform the steps in this article, your user account must be assigned the Owner or Contributor role for the Azure Machine Learning workspace, or a custom role must allow `Microsoft.MachineLearningServices/workspaces/onlineEndpoints/*`. For more information, see [Manage access to an Azure Machine Learning workspace](how-to-assign-roles.md).
6365

6466
---
6567

66-
* Ensure that you have enough virtual machine (VM) quota allocated for deployment. Azure Machine Learning reserves 20% of your compute resources for performing upgrades on some VM versions. For example, if you request 10 instances in a deployment, you must have a quota of 12 for each number of cores for the VM version. Failure to account for the extra compute resources results in an error. There are some VM versions that are exempt from the extra quota reservation. For more information on quota allocation, see [Virtual machine quota allocation for deployment](how-to-manage-quotas.md#virtual-machine-quota-allocation-for-deployment).
68+
* Ensure that you have enough virtual machine (VM) quota allocated for deployment. Azure Machine Learning reserves 20% of your compute resources for performing upgrades on some VM versions. For example, if you request 10 instances in a deployment, you must have a quota of 12 for each number of cores for the VM version. Failure to account for the extra compute resources results in an error. Some VM versions are exempt from the extra quota reservation. For more information on quota allocation, see [Virtual machine quota allocation for deployment](how-to-manage-quotas.md#virtual-machine-quota-allocation-for-deployment).
69+
6770
* Alternatively, you could use quota from the Azure Machine Learning shared quota pool for a limited time. [!INCLUDE [machine-learning-shared-quota](includes/machine-learning-shared-quota.md)]
6871

6972
## Prepare your system
@@ -156,7 +159,7 @@ If you have Git installed on your local machine, you can follow the instructions
156159

157160
### Clone the examples repository
158161

159-
To follow along with this article, first clone the [azureml-examples repository](https://github.com/azure/azureml-examples), then change into the *azureml-examples/cli/endpoints/online/model-1* directory.
162+
To follow along with this article, first clone the [azureml-examples repository](https://github.com/azure/azureml-examples), and then change into the *azureml-examples/cli/endpoints/online/model-1* directory.
160163

161164
```bash
162165
git clone --depth 1 https://github.com/Azure/azureml-examples
@@ -282,7 +285,7 @@ To set your endpoint name, run the following command to generate a random name.
282285

283286
### Configure the endpoint
284287

285-
To define the endpoint and deployment, this article uses Azure Resource Manager templates (ARM templates). The ARM templates that are used are [online-endpoint.json](https://github.com/Azure/azureml-examples/tree/main/arm-templates/online-endpoint.json) and [online-endpoint-deployment.json](https://github.com/Azure/azureml-examples/tree/main/arm-templates/online-endpoint-deployment.json). To use the templates for defining an online endpoint and deployment, see the [Deploy to Azure](#deploy-to-azure) section.
288+
To define the endpoint and deployment, this article uses the Azure Resource Manager templates (ARM templates) [online-endpoint.json](https://github.com/Azure/azureml-examples/tree/main/arm-templates/online-endpoint.json) and [online-endpoint-deployment.json](https://github.com/Azure/azureml-examples/tree/main/arm-templates/online-endpoint-deployment.json). To use the templates for defining an online endpoint and deployment, see the [Deploy to Azure](#deploy-to-azure) section.
286289

287290
---
288291

@@ -688,7 +691,7 @@ To register the example model, follow these steps:
688691

689692
:::image type="content" source="media/how-to-deploy-online-endpoints/register-model-folder.png" alt-text="Screenshot that shows the browse folder option." lightbox="media/how-to-deploy-online-endpoints/register-model-folder.png":::
690693

691-
1. Select the *\azureml-examples\cli\endpoints\online\model-1\model* folder from the local copy of the repo that you cloned or downloaded earlier. When prompted, select __Upload__ and wait for the upload to finish.
694+
1. Select the *\azureml-examples\cli\endpoints\online\model-1\model* folder from the local copy of the repo that you cloned or downloaded earlier. When you're prompted, select __Upload__ and wait for the upload to finish.
692695
1. Select __Next__.
693696
1. Enter a friendly name for the model. The steps in this article assume that the model is named `model-1`.
694697
1. Select __Next__, and then select __Register__ to finish registration.
@@ -1065,9 +1068,9 @@ By default, logs are pulled from the inference server container. To see logs fro
10651068

10661069
By using the `MLClient` parameter that you created earlier, you get a handle to the endpoint. You can then invoke the endpoint by using the `invoke` command with the following parameters:
10671070

1068-
- `endpoint_name`: Name of the endpoint
1069-
- `request_file`: File with request data
1070-
- `deployment_name`: Name of the specific deployment to test in an endpoint
1071+
- `endpoint_name`: Name of the endpoint.
1072+
- `request_file`: File with request data.
1073+
- `deployment_name`: Name of the specific deployment to test in an endpoint.
10711074

10721075
Send a sample request by using a [JSON](https://github.com/Azure/azureml-examples/blob/main/sdk/python/endpoints/online/model-1/sample-request.json) file.
10731076

0 commit comments

Comments
 (0)