You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-safely-rollout-online-endpoints.md
+31-18Lines changed: 31 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -29,7 +29,7 @@ In this article, you'll learn to:
29
29
30
30
> [!div class="checklist"]
31
31
> * Define an online endpoint with a deployment called "blue" to serve version 1 of a model
32
-
<!-- > * Scale the blue deployment so that it can handle more requests -->
32
+
> * Scale the blue deployment so that it can handle more requests
33
33
> * Deploy version 2 of the model (called the "green" deployment) to the endpoint, but send the deployment no live traffic
34
34
> * Test the green deployment in isolation
35
35
> * Mirror a percentage of live traffic to the green deployment to validate it (preview)
@@ -510,34 +510,30 @@ From the **Endpoint details page**
510
510
*__Choose an environment__ section: Select the **Scikit-learn 0.24.1** curated environment.
511
511
1. Select __Next__ to go to the "Compute" page. Here, keep the default selection for the virtual machine "Standard_DS3_v2" and change the __Instance count__ to 1.
512
512
1. Select __Next__ to go to the "Traffic" page. Here, keep the default traffic allocation to the deployments (100% traffic to "blue" and 0% traffic to "green").
513
-
1.Review your deployment settings and select the __Create__ button.
513
+
1.Select __Next__ to review your deployment settings.
514
514
515
-
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" alt-text="A screenshot of Add deployment option from Endpoint details page.":::
515
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-endpoint-page.png" alt-text="A screenshot of Add deployment option from Endpoint details page.":::
516
+
1. Select __Create__ to create the deployment.
516
517
517
518
Alternatively, you can use the **Models** page to add a deployment:
518
519
519
520
1. In the left navigation bar, select the **Models** page.
520
521
1. Select a model by checking the circle next to the model name.
521
522
1. Select **Deploy** > **Real-time endpoint**.
522
523
1. Choose to deploy to an existing managed online endpoint.
523
-
524
-
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" alt-text="A screenshot of Add deployment option from Models page.":::
524
+
:::image type="content" source="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" lightbox="media/how-to-safely-rollout-managed-endpoints/add-green-deployment-from-models-page.png" alt-text="A screenshot of Add deployment option from Models page.":::
525
+
1. Follow the previous steps 3 to 9 to finish creating the green deployment.
525
526
526
527
### Test the new deployment
527
528
528
-
Though `green` has 0% of traffic allocated, you can still invoke the endpoint and deployment with the [json](https://github.com/Azure/azureml-examples/tree/main/sdk/python/endpoints/online/model-2/sample-request.json) file.
Use the **Test** tab in the endpoint's details page to test your managed online deployment. Enter sample input and view the results.
529
+
Though `green` has 0% of traffic allocated, you can still invoke the endpoint and deployment. Use the **Test** tab in the endpoint's details page to test your managed online deployment. Enter sample input and view the results.
533
530
534
531
1. Select the **Test** tab in the endpoint's detail page.
535
532
1. Select the green deployment from the dropdown menu.
536
533
1. Copy the sample input from the [json](https://github.com/Azure/azureml-examples/tree/main/sdk/python/endpoints/online/model-2/sample-request.json) file.
537
534
1. Paste the sample input in the test box.
538
535
1. Select **Test**.
539
536
540
-
<!-- :::image type="content" source="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" lightbox="media/how-to-safely-rollout-managed-endpoints/test-deployment.png" alt-text="A screenshot of testing a deployment by providing sample data, directly in your browser."::: -->
541
537
542
538
<!--
543
539
> [!NOTE]
@@ -632,7 +628,7 @@ The studio doesn't support mirrored traffic. See the Azure CLI or Python tabs fo
632
628
633
629
---
634
630
635
-
## Test the new deployment with a small percentage of live traffic
631
+
## Allocate a small percentage of live traffic to the new deployment
636
632
637
633
# [Azure CLI](#tab/azure-cli)
638
634
@@ -648,7 +644,14 @@ Once you've tested your `green` deployment, allocate a small percentage of traff
648
644
649
645
# [Studio](#tab/azure-studio)
650
646
651
-
M.A: add details here from "Add a deployment to a managed online endpoint" section of "online endpoints in studio"
647
+
Once you've tested your `green` deployment, allocate a small percentage of traffic to it:
648
+
649
+
1. In the endpoint Details page, Select **Update traffic**.
650
+
1. Adjust the deployment traffic by allocating 10% to the green deployment and 90% to the blue deployment.
651
+
1. Select **Update**.
652
+
653
+
> [!TIP]
654
+
> The **Total traffic percentage** must sum to either 0% (to disable traffic) or 100% (to enable traffic).
652
655
653
656
---
654
657
@@ -672,12 +675,18 @@ Once you're fully satisfied with your `green` deployment, switch all traffic to
672
675
673
676
# [Studio](#tab/azure-studio)
674
677
675
-
M.A: add details here from "Add a deployment to a managed online endpoint" section of "online endpoints in studio"
678
+
Once you're fully satisfied with your `green` deployment, switch all traffic to it.
679
+
680
+
1. In the endpoint Details page, Select **Update traffic**.
681
+
1. Adjust the deployment traffic by allocating 100% to the green deployment and 0% to the blue deployment.
682
+
1. Select **Update**.
676
683
677
684
---
678
685
679
686
## Remove the old deployment
680
687
688
+
Use the following steps to delete an individual deployment from a managed online endpoint. This does affect the other deployments in the managed online endpoint:
@@ -688,27 +697,31 @@ M.A: add details here from "Add a deployment to a managed online endpoint" secti
688
697
689
698
# [Studio](#tab/azure-studio)
690
699
691
-
M.A: add details here
700
+
> [!NOTE]
701
+
> You cannot delete a deployment that has traffic allocated to it. You must first [set traffic allocation](#Send-all-traffic-to-your-new-deployment) for the deployment to 0% before deleting it.
702
+
703
+
1. In the endpoint Details page, find the blue deployment.
704
+
1. Select the **delete icon** next to the deployment name.
692
705
693
706
---
694
707
695
708
## Delete the endpoint and deployment
696
709
697
710
# [Azure CLI](#tab/azure-cli)
698
711
699
-
If you aren't going use the deployment, you should delete it with:
712
+
If you aren't going to use the endpoint and deployment, you should delete them. By deleting the endpoint, you'll also delete all its underlying deployments.
If you aren't going use the deployment, you should delete it with:
718
+
If you aren't going to use the endpoint and deployment, you should delete them. By deleting the endpoint, you'll also delete all its underlying deployments.
If you aren't going use the endpoint and deployment, you should delete them. By deleting the endpoint, you'll also delete all its underlying deployments.
724
+
If you aren't going to use the endpoint and deployment, you should delete them. By deleting the endpoint, you'll also delete all its underlying deployments.
712
725
713
726
1. Go to the [Azure Machine Learning studio](https://ml.azure.com).
714
727
1. In the left navigation bar, select the **Endpoints** page.
0 commit comments