You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: Run batch predictions using Azure Machine Learning designer
2
+
title: Run Batch Predictions Using Designer
3
3
titleSuffix: Azure Machine Learning
4
4
description: Learn how to create a batch prediction pipeline. Deploy the pipeline as a parameterized web service, and trigger it from any HTTP library.
In this article, you learn how to use the designer to create a batch prediction pipeline. Batch prediction lets you continuously score large datasets on-demand using a web service that can be triggered from any HTTP library.
21
21
22
-
In this how-to, you learn to do the following tasks:
22
+
In this how-to guide, you learn to do the following tasks:
23
23
24
24
> [!div class="checklist"]
25
-
> * Create and publish a batch inference pipeline
26
-
> * Consume a pipeline endpoint
27
-
> * Manage endpoint versions
25
+
> * Create and publish a batch inference pipeline.
26
+
> * Consume a pipeline endpoint.
27
+
> * Manage endpoint versions.
28
28
29
-
To learn how to set up batch scoring services using the SDK, see the accompanying [tutorial on pipeline batch scoring](../tutorial-pipeline-batch-scoring-classification.md).
29
+
To learn how to set up batch scoring services using the SDK, see [Tutorial: Build an Azure Machine Learning pipeline for image classification](../tutorial-pipeline-python-sdk.md).
30
30
31
31
## Prerequisites
32
32
33
33
This how-to assumes you already have a training pipeline. For a guided introduction to the designer, complete [part one of the designer tutorial](tutorial-designer-automobile-price-train-score.md).
34
34
35
35
> [!IMPORTANT]
36
-
> If you do not see graphical elements mentioned in this document, such as buttons in studio or designer, you may not have the right level of permissions to the workspace. Please contact your Azure subscription administrator to verify that you have been granted the correct level of access. For more information, see [Manage users and roles](../how-to-assign-roles.md).
36
+
> If you don't see graphical elements mentioned in this document, such as buttons in studio or designer, you might not have the right level of permissions to the workspace. Contact your Azure subscription administrator to verify that you have been granted the correct level of access. For more information, see [Manage users and roles](../how-to-assign-roles.md).
37
37
38
38
## Create a batch inference pipeline
39
39
40
40
Your training pipeline must be run at least once to be able to create an inferencing pipeline.
41
41
42
-
1.Go to the **Designer** tab in your workspace.
42
+
1.Sign in to the Machine Learning studio, then select **Designer**.
43
43
44
44
1. Select the training pipeline that trains the model you want to use to make prediction.
45
45
46
-
1.**Submit** the pipeline.
47
-
48
-

46
+
1. Select **Configure & Submit**.
49
47
50
48
:::image type="content" source="./media/how-to-run-batch-predictions-designer/run-training-pipeline.png" alt-text="Screenshot showing the set up pipeline job with the experiment drop-down and submit button highlighted." lightbox= "./media/how-to-run-batch-predictions-designer/run-training-pipeline.png":::
51
49
52
-
You'll see a submission list on the left of canvas. You can select the job detail link to go to the job detail page, and after the training pipeline job completes, you can create a batch inference pipeline.
You can select the job detail link to go to the job detail page, and after the training pipeline job completes, you can create a batch inference pipeline.
55
51
56
-
1.In job detail page, above the canvas, select the dropdown **Create inference pipeline**. Select **Batch inference pipeline**.
52
+
1.Select **Jobs** in the sidebar menu and choose your job. Above the canvas, select the dropdown **Create inference pipeline**. Select **Batch inference pipeline**.
57
53
58
54
> [!NOTE]
59
55
> Currently auto-generating inference pipeline only works for training pipeline built purely by the designer built-in components.
60
56
61
57
:::image type="content" source="./media/how-to-run-batch-predictions-designer/create-batch-inference.png" alt-text="Screenshot of the create inference pipeline drop-down with batch inference pipeline highlighted." lightbox= "./media/how-to-run-batch-predictions-designer/create-batch-inference.png":::
62
58
63
-
It will create a batch inference pipeline draft for you. The batch inference pipeline draft uses the trained model as **MD-** node and transformation as **TD-** node from the training pipeline job.
59
+
It creates a batch inference pipeline draft for you. The batch inference pipeline draft uses the trained model as **MD-** node and transformation as **TD-** node from the training pipeline job.
64
60
65
61
You can also modify this inference pipeline draft to better handle your input data for batch inference.
To create predictions on new data, you can either manually connect a different dataset in this pipeline draft view or create a parameter for your dataset. Parameters let you change the behavior of the batch inferencing process at runtime.
67
+
To create predictions on new data, you can either manually connect a different dataset in this pipeline draft view or create an input parameter for your dataset. Inputs let you change the behavior of the batch inferencing process at runtime.
72
68
73
-
In this section, you create a dataset parameter to specify a different dataset to make predictions on.
69
+
In this section, you create a pipeline input to specify a different dataset to make predictions on.
74
70
75
71
1. Select the dataset component.
76
72
77
-
1. A pane will appear to the right of the canvas. At the bottom of the pane, select **Set as pipeline parameter**.
78
-
79
-
Enter a name for the parameter, or accept the default value.
73
+
1. A pane appears to the right of the canvas. At the bottom of the pane, select **Set as pipeline input**.
80
74
81
-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/create-pipeline-parameter.png" alt-text="Screenshot of cleaned dataset tab with set as pipeline parameter checked." lightbox= "./media/how-to-run-batch-predictions-designer/create-pipeline-parameter.png":::
75
+
Enter a name for the parameter, or accept the default value.
82
76
77
+
:::image type="content" source="./media/how-to-run-batch-predictions-designer/create-pipeline-parameter.png" alt-text="Screenshot of cleaned dataset tab with set as pipeline input checked." lightbox= "./media/how-to-run-batch-predictions-designer/create-pipeline-parameter.png":::
83
78
84
-
1. Submit the batch inference pipeline and go to job detail page by selecting the job link in the left pane.
79
+
1. Submit the batch inference pipeline.
85
80
86
81
## Publish your batch inference pipeline
87
82
88
-
Now you're ready to deploy the inference pipeline. This will deploy the pipeline and make it available for others to use.
83
+
Now you're ready to deploy the inference pipeline. This deploys the pipeline and makes it available for others to use.
84
+
85
+
1. Select **Jobs** in the sidebar menu and select your running job.
89
86
90
-
1. Select the **Publish** button.
87
+
1. Select the **Publish** button in the ribbon menu.
91
88
92
-
1. In the dialog that appears, expand the drop-down for **PipelineEndpoint**, and select **New PipelineEndpoint**.
89
+
1. In the dialog that appears, **Create new**.
93
90
94
91
1. Provide an endpoint name and optional description.
95
92
96
-
Near the bottom of the dialog, you can see the parameter you configured with a default value of the dataset ID used during training.
93
+
Near the bottom of the dialog, you can see the input you configured with a default value of the dataset ID used during training.
97
94
98
95
1. Select **Publish**.
99
96
100
97
:::image type="content" source="./media/how-to-run-batch-predictions-designer/publish-inference-pipeline.png" alt-text="Screenshot of set up published pipeline." lightbox= "./media/how-to-run-batch-predictions-designer/publish-inference-pipeline.png":::
101
98
102
99
## Consume an endpoint
103
100
104
-
Now, you have a published pipeline with a dataset parameter. The pipeline will use the trained model created in the training pipeline to score the dataset you provide as a parameter.
101
+
Now, you have a published pipeline with a dataset parameter. The pipeline uses the trained model created in the training pipeline to score the dataset you provide as a parameter.
105
102
106
103
### Submit a pipeline job
107
104
108
-
In this section, you'll set up a manual pipeline job and alter the pipeline parameter to score new data.
105
+
In this section, you set up a manual pipeline job and alter the pipeline parameter to score new data.
109
106
110
-
1. After the deployment is complete, go to the **Endpoints**section.
107
+
1. After the deployment is complete, select **Pipelines**in the sidebar menu.
111
108
112
-
1. Select **Pipeline endpoints**.
109
+
1. Select the **Pipeline endpoints** tab.
113
110
114
111
1. Select the name of the endpoint you created.
115
112
116
-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/manage-endpoints.png" alt-text="Screenshot of the pipeline endpoint tab." :::
113
+
:::image type="content" source="./media/how-to-run-batch-predictions-designer/manage-endpoints.png" alt-text="Screenshot of the pipeline endpoint tab." :::
117
114
118
115
1. Select **Published pipelines**.
119
116
@@ -122,13 +119,13 @@ In this section, you'll set up a manual pipeline job and alter the pipeline para
122
119
1. Select the pipeline you published.
123
120
124
121
The pipeline details page shows you a detailed job history and connection string information for your pipeline.
125
-
122
+
126
123
1. Select **Submit** to create a manual run of the pipeline.
127
124
128
125
:::image type="content" source="./media/how-to-run-batch-predictions-designer/submit-manual-run.png" alt-text="Screenshot of set up pipeline job with parameters highlighted." lightbox= "./media/how-to-run-batch-predictions-designer/submit-manual-run.png" :::
129
-
126
+
130
127
1. Change the parameter to use a different dataset.
131
-
128
+
132
129
1. Select **Submit** to run the pipeline.
133
130
134
131
### Use the REST endpoint
@@ -139,45 +136,43 @@ You can find the REST endpoint of a pipeline endpoint in the job overview panel.
139
136
140
137
You can also consume a published pipeline in the **Published pipelines** page. Select a published pipeline and you can find the REST endpoint of it in the **Published pipeline overview** panel to the right of the graph.
141
138
142
-
To make a REST call, you'll need an OAuth 2.0 bearer-type authentication header. See the following [tutorial section](../tutorial-pipeline-batch-scoring-classification.md#publish-and-run-from-a-rest-endpoint) for more detail on setting up authentication to your workspace and making a parameterized REST call.
139
+
To make a REST call, you need an OAuth 2.0 bearer-type authentication header. See the following [tutorial section](../tutorial-pipeline-batch-scoring-classification.md#publish-and-run-from-a-rest-endpoint) for more detail on setting up authentication to your workspace and making a parameterized REST call.
143
140
144
141
## Versioning endpoints
145
142
146
-
The designer assigns a version to each subsequent pipeline that you publish to an endpoint. You can specify the pipeline version that you want to execute as a parameter in your REST call. If you don't specify a version number, the designer will use the default pipeline.
143
+
The designer assigns a version to each subsequent pipeline that you publish to an endpoint. You can specify the pipeline version that you want to execute as a parameter in your REST call. If you don't specify a version number, the designer uses the default pipeline.
147
144
148
145
When you publish a pipeline, you can choose to make it the new default pipeline for that endpoint.
149
146
150
147
:::image type="content" source="./media/how-to-run-batch-predictions-designer/set-default-pipeline.png" alt-text="Screenshot of set up published pipeline with set as default pipeline for this endpoint checked." :::
151
148
152
149
You can also set a new default pipeline in the **Published pipelines** tab of your endpoint.
153
150
154
-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/set-new-default-pipeline.png" alt-text="Screenshot of sample pipeline tab with set as default highlighted." :::
155
-
156
151
## Update pipeline endpoint
157
152
158
153
If you make some modifications in your training pipeline, you might want to update the newly trained model to the pipeline endpoint.
159
154
160
155
1. After your modified training pipeline completes successfully, go to the job detail page.
161
156
162
-
1. Rightclick **Train Model** component and select **Register data**
157
+
1. Right-click the **Train Model** component and select **Register data**.
163
158
164
159
:::image type="content" source="./media/how-to-run-batch-predictions-designer/register-train-model-as-dataset.png" alt-text="Screenshot of the train model component options with register data highlighted." lightbox= "./media/how-to-run-batch-predictions-designer/register-train-model-as-dataset.png" :::
165
160
166
-
Input name and select **File** type.
161
+
Input a name and select a**File** type.
167
162
168
163
:::image type="content" source="./media/how-to-run-batch-predictions-designer/register-train-model-as-dataset-2.png" alt-text="Screenshot of register as data asset with new data asset selected." lightbox= "./media/how-to-run-batch-predictions-designer/register-train-model-as-dataset-2.png" :::
169
164
170
-
1. Find the previous batch inference pipeline draft, or you can just **Clone** the published pipeline into a new draft.
165
+
1. Find the previous batch inference pipeline draft, or **Clone** the published pipeline into a new draft.
171
166
172
-
1. Replace the **MD-** node in the inference pipeline draft with the registered data in the step above.
167
+
1. Replace the **MD-** node in the inference pipeline draft with the registered data in the preceding step.
173
168
174
-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/update-inference-pipeline-draft.png" alt-text="Screenshot of updating the inference pipeline draft with the registered data in the step above." :::
169
+
:::image type="content" source="./media/how-to-run-batch-predictions-designer/update-inference-pipeline-draft.png" alt-text="Screenshot of updating the inference pipeline draft with the registered data." :::
175
170
176
171
1. Updating data transformation node **TD-** is the same as the trained model.
177
172
178
-
1.Then you can submit the inference pipeline with the updated model and transformation, and publish again.
173
+
1.Submit the inference pipeline with the updated model and transformation, and publish again.
179
174
180
-
## Next steps
175
+
## Related content
181
176
182
-
*Follow the [designer tutorial to train and deploy a regression model](tutorial-designer-automobile-price-train-score.md).
183
-
*For how to publish and run a published pipeline using the SDK v1, see the [How to deploy pipelines](how-to-deploy-pipelines.md?view=azureml-api-1&preserve-view=true) article.
177
+
*[Tutorial: Train a no-code regression model using designer](tutorial-designer-automobile-price-train-score.md)
0 commit comments