Skip to content

Commit 06757cc

Browse files
committed
adding more sections for the studio tab
1 parent 9848a4f commit 06757cc

File tree

1 file changed

+31
-18
lines changed

1 file changed

+31
-18
lines changed

articles/machine-learning/how-to-safely-rollout-online-endpoints.md

Lines changed: 31 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ In this article, you'll learn to:
2929

3030
> [!div class="checklist"]
3131
> * Define an online endpoint with a deployment called "blue" to serve version 1 of a model
32-
<!-- > * Scale the blue deployment so that it can handle more requests -->
32+
> * Scale the blue deployment so that it can handle more requests
3333
> * Deploy version 2 of the model (called the "green" deployment) to the endpoint, but send the deployment no live traffic
3434
> * Test the green deployment in isolation
3535
> * Mirror a percentage of live traffic to the green deployment to validate it (preview)
@@ -510,34 +510,30 @@ From the **Endpoint details page**
510510
* __Choose an environment__ section: Select the **Scikit-learn 0.24.1** curated environment.
511511
1. Select __Next__ to go to the "Compute" page. Here, keep the default selection for the virtual machine "Standard_DS3_v2" and change the __Instance count__ to 1.
512512
1. Select __Next__ to go to the "Traffic" page. Here, keep the default traffic allocation to the deployments (100% traffic to "blue" and 0% traffic to "green").
513-
1. Review your deployment settings and select the __Create__ button.
513+
1. Select __Next__ to review your deployment settings.
514514

515-
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" alt-text="A screenshot of Add deployment option from Endpoint details page.":::
515+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" alt-text="A screenshot of Add deployment option from Endpoint details page.":::
516+
1. Select __Create__ to create the deployment.
516517

517518
Alternatively, you can use the **Models** page to add a deployment:
518519

519520
1. In the left navigation bar, select the **Models** page.
520521
1. Select a model by checking the circle next to the model name.
521522
1. Select **Deploy** > **Real-time endpoint**.
522523
1. Choose to deploy to an existing managed online endpoint.
523-
524-
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" alt-text="A screenshot of Add deployment option from Models page.":::
524+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" alt-text="A screenshot of Add deployment option from Models page.":::
525+
1. Follow the previous steps 3 to 9 to finish creating the green deployment.
525526

526527
### Test the new deployment
527528

528-
Though `green` has 0% of traffic allocated, you can still invoke the endpoint and deployment with the [json](https://github.com/Azure/azureml-examples/tree/main/sdk/python/endpoints/online/model-2/sample-request.json) file.
529-
530-
[!notebook-python[](~/azureml-examples-main/sdk/python/endpoints/online/managed/online-endpoints-safe-rollout.ipynb?name=test_new_deployment)]
531-
532-
Use the **Test** tab in the endpoint's details page to test your managed online deployment. Enter sample input and view the results.
529+
Though `green` has 0% of traffic allocated, you can still invoke the endpoint and deployment. Use the **Test** tab in the endpoint's details page to test your managed online deployment. Enter sample input and view the results.
533530

534531
1. Select the **Test** tab in the endpoint's detail page.
535532
1. Select the green deployment from the dropdown menu.
536533
1. Copy the sample input from the [json](https://github.com/Azure/azureml-examples/tree/main/sdk/python/endpoints/online/model-2/sample-request.json) file.
537534
1. Paste the sample input in the test box.
538535
1. Select **Test**.
539536

540-
<!-- :::image type="content" source="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" lightbox="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" alt-text="A screenshot of testing a deployment by providing sample data, directly in your browser."::: -->
541537

542538
<!--
543539
> [!NOTE]
@@ -632,7 +628,7 @@ The studio doesn't support mirrored traffic. See the Azure CLI or Python tabs fo
632628

633629
---
634630

635-
## Test the new deployment with a small percentage of live traffic
631+
## Allocate a small percentage of live traffic to the new deployment
636632

637633
# [Azure CLI](#tab/azure-cli)
638634

@@ -648,7 +644,14 @@ Once you've tested your `green` deployment, allocate a small percentage of traff
648644

649645
# [Studio](#tab/azure-studio)
650646

651-
M.A: add details here from "Add a deployment to a managed online endpoint" section of "online endpoints in studio"
647+
Once you've tested your `green` deployment, allocate a small percentage of traffic to it:
648+
649+
1. In the endpoint Details page, Select **Update traffic**.
650+
1. Adjust the deployment traffic by allocating 10% to the green deployment and 90% to the blue deployment.
651+
1. Select **Update**.
652+
653+
> [!TIP]
654+
> The **Total traffic percentage** must sum to either 0% (to disable traffic) or 100% (to enable traffic).
652655
653656
---
654657

@@ -672,12 +675,18 @@ Once you're fully satisfied with your `green` deployment, switch all traffic to
672675

673676
# [Studio](#tab/azure-studio)
674677

675-
M.A: add details here from "Add a deployment to a managed online endpoint" section of "online endpoints in studio"
678+
Once you're fully satisfied with your `green` deployment, switch all traffic to it.
679+
680+
1. In the endpoint Details page, Select **Update traffic**.
681+
1. Adjust the deployment traffic by allocating 100% to the green deployment and 0% to the blue deployment.
682+
1. Select **Update**.
676683

677684
---
678685

679686
## Remove the old deployment
680687

688+
Use the following steps to delete an individual deployment from a managed online endpoint. This does affect the other deployments in the managed online endpoint:
689+
681690
# [Azure CLI](#tab/azure-cli)
682691

683692
:::code language="azurecli" source="~/azureml-examples-main/cli/deploy-safe-rollout-online-endpoints.sh" ID="delete_blue" :::
@@ -688,27 +697,31 @@ M.A: add details here from "Add a deployment to a managed online endpoint" secti
688697

689698
# [Studio](#tab/azure-studio)
690699

691-
M.A: add details here
700+
> [!NOTE]
701+
> You cannot delete a deployment that has traffic allocated to it. You must first [set traffic allocation](#Send-all-traffic-to-your-new-deployment) for the deployment to 0% before deleting it.
702+
703+
1. In the endpoint Details page, find the blue deployment.
704+
1. Select the **delete icon** next to the deployment name.
692705

693706
---
694707

695708
## Delete the endpoint and deployment
696709

697710
# [Azure CLI](#tab/azure-cli)
698711

699-
If you aren't going use the deployment, you should delete it with:
712+
If you aren't going to use the endpoint and deployment, you should delete them. By deleting the endpoint, you'll also delete all its underlying deployments.
700713

701714
:::code language="azurecli" source="~/azureml-examples-main/cli/deploy-safe-rollout-online-endpoints.sh" ID="delete_endpoint" :::
702715

703716
# [Python](#tab/python)
704717

705-
If you aren't going use the deployment, you should delete it with:
718+
If you aren't going to use the endpoint and deployment, you should delete them. By deleting the endpoint, you'll also delete all its underlying deployments.
706719

707720
[!notebook-python[](~/azureml-examples-main/sdk/python/endpoints/online/managed/online-endpoints-safe-rollout.ipynb?name=delete_endpoint)]
708721

709722
# [Studio](#tab/azure-studio)
710723

711-
If you aren't going use the endpoint and deployment, you should delete them. By deleting the endpoint, you'll also delete all its underlying deployments.
724+
If you aren't going to use the endpoint and deployment, you should delete them. By deleting the endpoint, you'll also delete all its underlying deployments.
712725

713726
1. Go to the [Azure Machine Learning studio](https://ml.azure.com).
714727
1. In the left navigation bar, select the **Endpoints** page.

0 commit comments

Comments
 (0)