You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-safely-rollout-online-endpoints.md
+25-14Lines changed: 25 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -186,7 +186,7 @@ To define an endpoint, you need to specify:
186
186
187
187
### Create online endpoint
188
188
189
-
Begin by setting the endpoint's name and then configuring it. In this article, you'll use the *endpoints/online/managed/sample/endpoint.yml* file to configure the endpoint. The following snippet shows the contents of the file:
189
+
First set the endpoint's name and then configure it. In this article, you'll use the *endpoints/online/managed/sample/endpoint.yml* file to configure the endpoint. The following snippet shows the contents of the file:
@@ -217,7 +217,11 @@ To create an online endpoint:
217
217
218
218
### Create the 'blue' deployment
219
219
220
-
A deployment is a set of resources required for hosting the model that does the actual inferencing. To create a deployment named `blue` for your endpoint, run the following command to use the `blue-deployment.yml` file to configure the key aspects of the deployment:<!-- [link to "define the deployment" section in Deploy article] -->
220
+
A deployment is a set of resources required for hosting the model that does the actual inferencing. In this article, you'll use the *endpoints/online/managed/sample/blue-deployment.yml* file to configure the key aspects of the deployment:<!-- [link to "define the deployment" section in Deploy article] -->. The following snippet shows the contents of the file:
@@ -279,9 +283,9 @@ A deployment is a set of resources required for hosting the model that does the
279
283
280
284
# [Studio](#tab/azure-studio)
281
285
282
-
When you create a managed online endpoint in the Azure Machine Learning studio, you must define an initial deployment for the endpoint. To define a deployment, you must have a registered model in your workspace. Let's begin by registering the model that we'll use for the deployment.
286
+
When you create a managed online endpoint in the Azure Machine Learning studio, you must define an initial deployment for the endpoint. Before you can define a deployment, you must have a registered model in your workspace. Let's begin by registering the model to use for the deployment.
283
287
284
-
### Register the model
288
+
### Register your model
285
289
286
290
A model registration is a logical entity in the workspace. This entity may contain a single model file or a directory of multiple files. As a best practice for production, you should register the model and environment. When creating the endpoint and deployment in this article, we'll assume that you've registered the [model folder](https://github.com/Azure/azureml-examples/tree/main/cli/endpoints/online/model-1/model) that contains the model.
287
291
@@ -293,7 +297,7 @@ To register the example model, follow these steps:
293
297
1. Select __Unspecified type__ for the __Model type__.
294
298
1. Select __Browse__, and choose __Browse folder__.
295
299
296
-
:::image type="content" source="media/how-to-deploy-online-endpoints/register-model-folder.png" alt-text="A screenshot of the browse folder option." lightbox="media/how-to-deploy-online-endpoints/register-model-folder.png":::
300
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/register-model-folder.png" alt-text="A screenshot of the browse folder option." lightbox="media/how-to-safely-rollout-managed-endpoints/register-model-folder.png":::
297
301
298
302
1. Select the `\azureml-examples\cli\endpoints\online\model-1\model` folder from the local copy of the repo you cloned or downloaded earlier. When prompted, select __Upload__ and wait for the upload to complete.
299
303
1. Select __Next__ after the folder upload is completed.
@@ -306,7 +310,7 @@ For information on creating an environment in the studio, see [Create an environ
306
310
307
311
### Create a managed online endpoint and the 'blue' deployment
308
312
309
-
Use the studio to create a managed online endpoint directly in your browser. When you create a managed online endpoint in the studio, you must define an initial deployment. You can't create an empty managed online endpoint.
313
+
Use the Azure machine learning studio to create a managed online endpoint directly in your browser. When you create a managed online endpoint in the studio, you must define an initial deployment. You can't create an empty managed online endpoint.
310
314
311
315
One way to create a managed online endpoint in the studio is from the **Models** page. This method also provides an easy way to add a model to an existing managed online deployment. To deploy the model named `model-1` that you registered previously in the [Register the model](#register-the-model) section:
312
316
@@ -315,11 +319,11 @@ One way to create a managed online endpoint in the studio is from the **Models**
315
319
1. Select the model named `model-1` by checking the circle next to its name.
316
320
1. Select **Deploy** > **Deploy to real-time endpoint**.
317
321
318
-
:::image type="content" source="media/how-to-deploy-online-endpoints/deploy-from-models-page.png" lightbox="media/how-to-deploy-online-endpoints/deploy-from-models-page.png" alt-text="A screenshot of creating a managed online endpoint from the Models UI.":::
322
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/deploy-from-models-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/deploy-from-models-page.png" alt-text="A screenshot of creating a managed online endpoint from the Models UI.":::
319
323
320
324
This action opens up a window where you can specify details about your endpoint.
321
325
322
-
:::image type="content" source="media/how-to-deploy-online-endpoints/online-endpoint-wizard.png" lightbox="media/how-to-deploy-online-endpoints/online-endpoint-wizard.png" alt-text="A screenshot of a managed online endpoint create wizard.":::
326
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/online-endpoint-wizard.png" lightbox="media/how-to-safely-rollout-managed-endpoints/online-endpoint-wizard.png" alt-text="A screenshot of a managed online endpoint create wizard.":::
323
327
324
328
1. Enter an __Endpoint name__.
325
329
@@ -329,24 +333,31 @@ One way to create a managed online endpoint in the studio is from the **Models**
329
333
> * Optionally, you can add a description and tags to your endpoint.
330
334
331
335
1. Keep the default selections: __Managed__ for the compute type and __key-based authentication__ for the authentication type.
332
-
1. Select __Next__, until you get to the "Deployment" page. Here, check the box for __Enable Application Insights diagnostics and data collection__ to allow you view graphs of your endpoint's activities in the studio later.
336
+
1. Select __Next__, until you get to the "Deployment" page. Here, perform the following tasks:
337
+
338
+
* Name the deployment "blue".
339
+
* Check the box for __Enable Application Insights diagnostics and data collection__ to allow you view graphs of your endpoint's activities in the studio later.
340
+
333
341
1. Select __Next__ to go to the "Environment" page. Here, select the following options:
334
342
335
343
*__Select scoring file and dependencies__: Browse and select the `\azureml-examples\cli\endpoints\online\model-1\onlinescoring\score.py` file from the repo you cloned or downloaded earlier.
336
344
*__Choose an environment__ section: Select the **Scikit-learn 0.24.1** curated environment.
337
345
338
-
1. Select __Next__, accepting defaults, until you're prompted to create the deployment.
346
+
1. Select __Next__ to go to the "Compute" page. Here, keep the default selection for the virtual machine "Standard_DS3_v2" and change the __Instance count__ to 1.
347
+
1. Select __Next__, to accept the default traffic allocation (100%) to the blue deployment.
339
348
1. Review your deployment settings and select the __Create__ button.
340
349
350
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/review-deployment-creation-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/review-deployment-creation-page.png" alt-text="A screenshot showing the review page for creating a managed online endpoint with a deployment.":::
351
+
341
352
Alternatively, you can create a managed online endpoint from the **Endpoints** page in the studio.
342
353
343
354
1. Go to the [Azure Machine Learning studio](https://ml.azure.com).
344
355
1. In the left navigation bar, select the **Endpoints** page.
345
356
1. Select **+ Create**.
346
357
347
-
:::image type="content" source="media/how-to-deploy-online-endpoints/endpoint-create-managed-online-endpoint.png" lightbox="media/how-to-deploy-online-endpoints/endpoint-create-managed-online-endpoint.png" alt-text="A screenshot for creating managed online endpoint from the Endpoints tab.":::
358
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/endpoint-create-managed-online-endpoint.png" lightbox="media/how-to-safely-rollout-managed-endpoints/endpoint-create-managed-online-endpoint.png" alt-text="A screenshot for creating managed online endpoint from the Endpoints tab.":::
348
359
349
-
This action opens up a window for you to specify details about your endpoint and deployment. Enter settings for your endpoint and deployment as described in the previous steps 5-10, accepting defaults until you're prompted to __Create__ the deployment.
360
+
This action opens up a window for you to specify details about your endpoint and deployment. Enter settings for your endpoint and deployment as described in the previous steps 5-11, accepting defaults until you're prompted to __Create__ the deployment.
350
361
351
362
---
352
363
@@ -400,7 +411,7 @@ You can view all your managed online endpoints in the **Endpoints** page. Go to
400
411
1. (Optional) Create a **Filter** on **Compute type** to show only **Managed** compute types.
401
412
1. Select an endpoint name to view the endpoint's __Details__ page.
402
413
403
-
:::image type="content" source="media/how-to-deploy-online-endpoints/managed-endpoint-details-page.png" lightbox="media/how-to-deploy-online-endpoints/managed-endpoint-details-page.png" alt-text="Screenshot of managed endpoint details view.":::
414
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/managed-endpoint-details-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/managed-endpoint-details-page.png" alt-text="Screenshot of managed endpoint details view.":::
404
415
405
416
### Test the endpoint with sample data
406
417
@@ -411,7 +422,7 @@ Use the **Test** tab in the endpoint's details page to test your managed online
411
422
1. Enter sample input.
412
423
1. Select **Test**.
413
424
414
-
:::image type="content" source="media/how-to-deploy-online-endpoints/test-deployment.png" lightbox="media/how-to-deploy-online-endpoints/test-deployment.png" alt-text="A screenshot of testing a deployment by providing sample data, directly in your browser.":::
425
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" lightbox="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" alt-text="A screenshot of testing a deployment by providing sample data, directly in your browser.":::
0 commit comments