You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-use-batch-model-deployments.md
+26-12Lines changed: 26 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ ms.topic: how-to
9
9
author: santiagxf
10
10
ms.author: fasantia
11
11
ms.reviewer: mopeakande
12
-
ms.date: 03/29/2024
12
+
ms.date: 04/02/2024
13
13
ms.custom: how-to, devplatv2, update-code
14
14
#Customer intent: As an ML engineer or data scientist, I want to create an endpoint to host my models for batch scoring, so that I can use the same endpoint continuously for different large datasets on-demand or on-schedule.
15
15
---
@@ -56,7 +56,7 @@ az configure --defaults workspace=<workspace> group=<resource-group> location=<l
56
56
57
57
# [Python](#tab/python)
58
58
59
-
The workspace is the top-level resource for Azure Machine Learning, providing a centralized place to work with all the artifacts you create when you use Azure Machine Learning. In this section, we'll connect to the workspace in which you'll perform deployment tasks.
59
+
The workspace is the top-level resource for Azure Machine Learning, providing a centralized place to work with all the artifacts you create when you use Azure Machine Learning. In this section, you connect to the workspace in which you'll perform deployment tasks.
60
60
61
61
1. Import the required libraries:
62
62
@@ -261,13 +261,21 @@ A model deployment is a set of resources required for hosting the model that doe
261
261
In the [Azure Machine Learning studio](https://ml.azure.com), follow these steps:
262
262
263
263
1. Navigate to the __Environments__ tab on the side menu.
264
+
264
265
1. Select the tab __Custom environments__ > __Create__.
266
+
265
267
1. Enter the name of the environment, in this case `torch-batch-env`.
266
-
1. For __Select environment source__ select __Use existing docker image with optional conda file__.
268
+
269
+
1. For __Select environment source__, select __Use existing docker image with optional conda file__.
270
+
267
271
1. For __Container registry image path__, enter `mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04`.
272
+
268
273
1. Select **Next** to go to the "Customize" section.
274
+
269
275
1. Copy the content of the file _deployment-torch/environment/conda.yaml_ from the GitHub repo into the portal.
276
+
270
277
1. Select __Next__ until you get to the "Review page".
278
+
271
279
1. Select __Create__ and wait until the environment is ready for use.
272
280
273
281
---
@@ -481,7 +489,7 @@ You can run and invoke a batch endpoint using Azure CLI, Azure Machine Learning
481
489
1. For "Path", enter the full URL`https://azuremlexampledata.blob.core.windows.net/data/mnist/sample`.
482
490
483
491
> [!TIP]
484
-
> This path work only because the given path has public access enabled. In general, youl need to register the data source as a __Datastore__. See [Accessing data from batch endpoints jobs](how-to-access-data-batch-endpoints-jobs.md) for details.
492
+
> This path works only because the given path has public access enabled. In general, you need to register the data source as a __Datastore__. See [Accessing data from batch endpoints jobs](how-to-access-data-batch-endpoints-jobs.md) for details.
485
493
486
494
:::image type="content" source="./media/how-to-use-batch-model-deployments/select-datastore-job.png" alt-text="Screenshot of selecting datastore as an input option." lightbox="media/how-to-use-batch-model-deployments/select-datastore-job.png":::
487
495
@@ -521,11 +529,9 @@ The following code checks the job status and outputs a link to the Azure Machine
521
529
522
530
:::image type="content" source="media/how-to-use-batch-model-deployments/summary-jobs.png" alt-text="Screenshot of summary of jobs submitted to a batch endpoint." lightbox="media/how-to-use-batch-model-deployments/summary-jobs.png":::
523
531
524
-
1. You'll see a list of the jobs created for the selected endpoint.
532
+
1. From the displayedlist of the jobs created for the selected endpoint, select the last job that is running.
525
533
526
-
1. Select the last job that is running.
527
-
528
-
1. You'll be redirected to the job monitoring page.
534
+
1. You're now redirected to the job monitoring page.
529
535
530
536
---
531
537
@@ -678,13 +684,21 @@ In this example, you add a second deployment that uses a __model built with Kera
678
684
# [Studio](#tab/azure-studio)
679
685
680
686
1. Navigate to the __Environments__ tab on the side menu.
687
+
681
688
1. Select the tab __Custom environments__ > __Create__.
689
+
682
690
1. Enter the name of the environment, in this case `keras-batch-env`.
691
+
683
692
1. For __Select environment source__, select __Use existing docker image with optional conda file__.
693
+
684
694
1. For __Container registry image path__, enter `mcr.microsoft.com/azureml/openmpi4.1.0-ubuntu20.04`.
695
+
685
696
1. Select **Next** to go to the "Customize" section.
697
+
686
698
1. Copy the content of the file _deployment-keras/environment/conda.yaml_ from the GitHub repo into the portal.
699
+
687
700
1. Select __Next__ until you get to the "Review page".
701
+
688
702
1. Select __Create__ and wait until the environment is ready for use.
689
703
690
704
---
@@ -731,7 +745,7 @@ In this example, you add a second deployment that uses a __model built with Kera
731
745
732
746
1. On the deployment configuration page, give the deployment a name.
733
747
734
-
1. Unselect the option to __Make this new deployment the default for batch jobs__.
748
+
1. Undo the selection for the option: __Make this new deployment the default for batch jobs__.
735
749
736
750
1. For __Output action__, ensure __Append row__ is selected.
737
751
@@ -747,7 +761,7 @@ In this example, you add a second deployment that uses a __model built with Kera
747
761
748
762
1. For __Select a scoring script for inferencing__, browse to select the scoring script file*deployment-keras/code/batch_driver.py*.
749
763
750
-
1. For __Select environment__, select the environment you created ina previous step.
764
+
1. For __Select environment__, select the environment you created in a previous step.
751
765
752
766
1. Select __Next__.
753
767
@@ -806,7 +820,7 @@ Notice `deployment_name` is used to specify the deployment to execute. This para
806
820
807
821
1. Select __Create job__.
808
822
809
-
1. On __Deployment__, select the deployment you want to execute. In this case, `mnist-keras`.
823
+
1. For __Deployment__, select the deployment you want to execute. In this case, `mnist-keras`.
810
824
811
825
1. Complete the job creation wizard to get the job started.
812
826
@@ -836,7 +850,7 @@ Although you can invoke a specific deployment inside an endpoint, you'll typical
836
850
837
851
:::image type="content" source="./media/how-to-use-batch-model-deployments/update-default-deployment.png" alt-text="Screenshot of updating default deployment.":::
838
852
839
-
1. On __Select default deployment__, select the name of the deployment you want to setas the default.
853
+
1. For __Select default deployment__, select the name of the deployment you want to setas the default.
Copy file name to clipboardExpand all lines: articles/machine-learning/includes/azureml-batch-prereqs-with-studio.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,21 +2,21 @@
2
2
author: santiagxf
3
3
ms.service: machine-learning
4
4
ms.topic: include
5
-
ms.date: 03/19/2024
5
+
ms.date: 04/02/2024
6
6
ms.author: fasantia
7
7
---
8
8
9
9
Before you follow the steps in this article, make sure you have the following prerequisites:
10
10
11
11
* An Azure subscription. If you don't have an Azure subscription, create a free account before you begin. Try the [free or paid version of Azure Machine Learning](https://azure.microsoft.com/free/).
12
12
13
-
* An Azure Machine Learning workspace. If you don't have one, use the steps in the [How to manage workspaces](../how-to-manage-workspace.md) to create one.
13
+
* An Azure Machine Learning workspace. If you don't have one, use the steps in the [How to manage workspaces](../how-to-manage-workspace.md)article to create one.
14
14
15
-
*Ensure you have the following permissions in the workspace:
15
+
*To perform the following tasks, ensure that you have these permissions in the workspace:
16
16
17
-
*Create/manage batch endpoints and deployments: Use roles Owner, contributor, or custom role allowing `Microsoft.MachineLearningServices/workspaces/batchEndpoints/*`.
17
+
*To create/manage batch endpoints and deployments: Use owner role, contributor role, or a custom role allowing `Microsoft.MachineLearningServices/workspaces/batchEndpoints/*`.
18
18
19
-
*Create ARM deployments in the workspace resource group: Use roles Owner, contributor, or custom role allowing `Microsoft.Resources/deployments/write` in the resource group where the workspace is deployed.
19
+
*To create ARM deployments in the workspace resource group: Use owner role, contributor role, or a custom role allowing `Microsoft.Resources/deployments/write` in the resource group where the workspace is deployed.
20
20
21
21
* You need to install the following software to work with Azure Machine Learning:
0 commit comments