You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-safely-rollout-online-endpoints.md
+53-4Lines changed: 53 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -303,6 +303,7 @@ To register the example model, follow these steps:
303
303
1. Select __Next__ after the folder upload is completed.
304
304
1. Enter a friendly __Name__ for the model. The steps in this article assume the model is named `model-1`.
305
305
1. Select __Next__, and then __Register__ to complete registration.
306
+
1. Repeat the previous steps to register a `model-2` from the `\azureml-examples\cli\endpoints\online\model-2\model` folder in the local copy of the repo you cloned or downloaded earlier.
306
307
307
308
For more information on working with registered models, see [Register and work with models](how-to-manage-models.md).
308
309
@@ -417,9 +418,9 @@ You can view all your managed online endpoints in the **Endpoints** page. Go to
417
418
418
419
Use the **Test** tab in the endpoint's details page to test your managed online deployment. Enter sample input and view the results.
419
420
420
-
1. Select the **Test** tab in the endpoint's detail page.
421
-
1.Use the dropdown to select the deployment you want to test.
422
-
1.Enter sample input.
421
+
1. Select the **Test** tab in the endpoint's detail page. The blue deployment is already selected in the dropdown menu.
422
+
1.Copy the sample input from the [json](https://github.com/Azure/azureml-examples/tree/main/sdk/python/endpoints/online/model-1/sample-request.json) file
423
+
1.Paste the sample input in the test box.
423
424
1. Select **Test**.
424
425
425
426
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" lightbox="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" alt-text="A screenshot of testing a deployment by providing sample data, directly in your browser.":::
@@ -494,7 +495,55 @@ Though `green` has 0% of traffic allocated, you can still invoke the endpoint an
494
495
495
496
# [Studio](#tab/azure-studio)
496
497
497
-
M.A: add details here from "Add a deployment to a managed online endpoint" section of "online endpoints in studio"
498
+
Create a new deployment to add to your managed online endpoint and name the deployment `green`.
499
+
500
+
From the **Endpoint details page**
501
+
502
+
1. Select **+ Add Deployment** button in the endpoint "Details" page.
503
+
1. Select **Deploy a model**.
504
+
1. Select **Next** to go to the "Model" page and select the model _model-2_.
505
+
1. Select **Next** to go to the "Deployment" page and perform the following tasks:
506
+
1. Name the deployment "green".
507
+
1. Enable application insights diagnostics and data collection.
508
+
1. Select __Next__ to go to the "Environment" page. Here, select the following options:
509
+
*__Select scoring file and dependencies__: Browse and select the `\azureml-examples\cli\endpoints\online\model-2\onlinescoring\score.py` file from the repo you cloned or downloaded earlier.
510
+
*__Choose an environment__ section: Select the **Scikit-learn 0.24.1** curated environment.
511
+
1. Select __Next__ to go to the "Compute" page. Here, keep the default selection for the virtual machine "Standard_DS3_v2" and change the __Instance count__ to 1.
512
+
1. Select __Next__ to go to the "Traffic" page. Here, keep the default traffic allocation to the deployments (100% traffic to "blue" and 0% traffic to "green").
513
+
1. Review your deployment settings and select the __Create__ button.
514
+
515
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" alt-text="A screenshot of Add deployment option from Endpoint details page.":::
516
+
517
+
Alternatively, you can use the **Models** page to add a deployment:
518
+
519
+
1. In the left navigation bar, select the **Models** page.
520
+
1. Select a model by checking the circle next to the model name.
521
+
1. Select **Deploy** > **Real-time endpoint**.
522
+
1. Choose to deploy to an existing managed online endpoint.
523
+
524
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" alt-text="A screenshot of Add deployment option from Models page.":::
525
+
526
+
### Test the new deployment
527
+
528
+
Though `green` has 0% of traffic allocated, you can still invoke the endpoint and deployment with the [json](https://github.com/Azure/azureml-examples/tree/main/sdk/python/endpoints/online/model-2/sample-request.json) file.
Use the **Test** tab in the endpoint's details page to test your managed online deployment. Enter sample input and view the results.
533
+
534
+
1. Select the **Test** tab in the endpoint's detail page.
535
+
1. Select the green deployment from the dropdown menu.
536
+
1. Copy the sample input from the [json](https://github.com/Azure/azureml-examples/tree/main/sdk/python/endpoints/online/model-2/sample-request.json) file.
537
+
1. Paste the sample input in the test box.
538
+
1. Select **Test**.
539
+
540
+
<!-- :::image type="content" source="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" lightbox="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" alt-text="A screenshot of testing a deployment by providing sample data, directly in your browser."::: -->
541
+
542
+
<!--
543
+
> [!NOTE]
544
+
> You can adjust the traffic balance between deployments in an endpoint when adding a new deployment.
545
+
>
546
+
> :::image type="content" source="media/how-to-create-managed-online-endpoint-studio/adjust-deployment-traffic.png" lightbox="media/how-to-create-managed-online-endpoint-studio/adjust-deployment-traffic.png" alt-text="A screenshot of how to use sliders to control traffic distribution across multiple deployments."::: -->
0 commit comments