Skip to content

Commit 72f3463

Browse files
committed
Refresh article
1 parent 204e108 commit 72f3463

File tree

8 files changed

+45
-50
lines changed

8 files changed

+45
-50
lines changed
Lines changed: 45 additions & 50 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: Run batch predictions using Azure Machine Learning designer
2+
title: Run Batch Predictions Using Designer
33
titleSuffix: Azure Machine Learning
44
description: Learn how to create a batch prediction pipeline. Deploy the pipeline as a parameterized web service, and trigger it from any HTTP library.
55
services: machine-learning
@@ -8,7 +8,7 @@ ms.subservice: mlops
88
ms.author: lagayhar
99
author: lgayhardt
1010
ms.reviewer: keli19
11-
ms.date: 05/10/2022
11+
ms.date: 06/16/2025
1212
ms.topic: how-to
1313
ms.custom: UpdateFrequency5, designer
1414
---
@@ -19,101 +19,98 @@ ms.custom: UpdateFrequency5, designer
1919

2020
In this article, you learn how to use the designer to create a batch prediction pipeline. Batch prediction lets you continuously score large datasets on-demand using a web service that can be triggered from any HTTP library.
2121

22-
In this how-to, you learn to do the following tasks:
22+
In this how-to guide, you learn to do the following tasks:
2323

2424
> [!div class="checklist"]
25-
> * Create and publish a batch inference pipeline
26-
> * Consume a pipeline endpoint
27-
> * Manage endpoint versions
25+
> * Create and publish a batch inference pipeline.
26+
> * Consume a pipeline endpoint.
27+
> * Manage endpoint versions.
2828
29-
To learn how to set up batch scoring services using the SDK, see the accompanying [tutorial on pipeline batch scoring](../tutorial-pipeline-batch-scoring-classification.md).
29+
To learn how to set up batch scoring services using the SDK, see [Tutorial: Build an Azure Machine Learning pipeline for image classification](../tutorial-pipeline-python-sdk.md).
3030

3131
## Prerequisites
3232

3333
This how-to assumes you already have a training pipeline. For a guided introduction to the designer, complete [part one of the designer tutorial](tutorial-designer-automobile-price-train-score.md).
3434

3535
> [!IMPORTANT]
36-
> If you do not see graphical elements mentioned in this document, such as buttons in studio or designer, you may not have the right level of permissions to the workspace. Please contact your Azure subscription administrator to verify that you have been granted the correct level of access. For more information, see [Manage users and roles](../how-to-assign-roles.md).
36+
> If you don't see graphical elements mentioned in this document, such as buttons in studio or designer, you might not have the right level of permissions to the workspace. Contact your Azure subscription administrator to verify that you have been granted the correct level of access. For more information, see [Manage users and roles](../how-to-assign-roles.md).
3737
3838
## Create a batch inference pipeline
3939

4040
Your training pipeline must be run at least once to be able to create an inferencing pipeline.
4141

42-
1. Go to the **Designer** tab in your workspace.
42+
1. Sign in to the Machine Learning studio, then select **Designer**.
4343

4444
1. Select the training pipeline that trains the model you want to use to make prediction.
4545

46-
1. **Submit** the pipeline.
47-
48-
![Submit the pipeline](./media/how-to-run-batch-predictions-designer/run-training-pipeline.png)
46+
1. Select **Configure & Submit**.
4947

5048
:::image type="content" source="./media/how-to-run-batch-predictions-designer/run-training-pipeline.png" alt-text="Screenshot showing the set up pipeline job with the experiment drop-down and submit button highlighted." lightbox= "./media/how-to-run-batch-predictions-designer/run-training-pipeline.png":::
5149

52-
You'll see a submission list on the left of canvas. You can select the job detail link to go to the job detail page, and after the training pipeline job completes, you can create a batch inference pipeline.
53-
54-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/submission-list.png" alt-text="Screenshot showing the submitted job list." lightbox= "./media/how-to-run-batch-predictions-designer/submission-list.png":::
50+
You can select the job detail link to go to the job detail page, and after the training pipeline job completes, you can create a batch inference pipeline.
5551

56-
1. In job detail page, above the canvas, select the dropdown **Create inference pipeline**. Select **Batch inference pipeline**.
52+
1. Select **Jobs** in the sidebar menu and choose your job. Above the canvas, select the dropdown **Create inference pipeline**. Select **Batch inference pipeline**.
5753

5854
> [!NOTE]
5955
> Currently auto-generating inference pipeline only works for training pipeline built purely by the designer built-in components.
6056
6157
:::image type="content" source="./media/how-to-run-batch-predictions-designer/create-batch-inference.png" alt-text="Screenshot of the create inference pipeline drop-down with batch inference pipeline highlighted." lightbox= "./media/how-to-run-batch-predictions-designer/create-batch-inference.png":::
6258

63-
It will create a batch inference pipeline draft for you. The batch inference pipeline draft uses the trained model as **MD-** node and transformation as **TD-** node from the training pipeline job.
59+
It creates a batch inference pipeline draft for you. The batch inference pipeline draft uses the trained model as **MD-** node and transformation as **TD-** node from the training pipeline job.
6460

6561
You can also modify this inference pipeline draft to better handle your input data for batch inference.
6662

6763
:::image type="content" source="./media/how-to-run-batch-predictions-designer/batch-inference-draft.png" alt-text="Screenshot showing a batch inference pipeline draft." lightbox= "./media/how-to-run-batch-predictions-designer/batch-inference-draft.png":::
6864

69-
### Add a pipeline parameter
65+
### Add a pipeline input
7066

71-
To create predictions on new data, you can either manually connect a different dataset in this pipeline draft view or create a parameter for your dataset. Parameters let you change the behavior of the batch inferencing process at runtime.
67+
To create predictions on new data, you can either manually connect a different dataset in this pipeline draft view or create an input parameter for your dataset. Inputs let you change the behavior of the batch inferencing process at runtime.
7268

73-
In this section, you create a dataset parameter to specify a different dataset to make predictions on.
69+
In this section, you create a pipeline input to specify a different dataset to make predictions on.
7470

7571
1. Select the dataset component.
7672

77-
1. A pane will appear to the right of the canvas. At the bottom of the pane, select **Set as pipeline parameter**.
78-
79-
Enter a name for the parameter, or accept the default value.
73+
1. A pane appears to the right of the canvas. At the bottom of the pane, select **Set as pipeline input**.
8074

81-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/create-pipeline-parameter.png" alt-text="Screenshot of cleaned dataset tab with set as pipeline parameter checked." lightbox= "./media/how-to-run-batch-predictions-designer/create-pipeline-parameter.png":::
75+
Enter a name for the parameter, or accept the default value.
8276

77+
:::image type="content" source="./media/how-to-run-batch-predictions-designer/create-pipeline-parameter.png" alt-text="Screenshot of cleaned dataset tab with set as pipeline input checked." lightbox= "./media/how-to-run-batch-predictions-designer/create-pipeline-parameter.png":::
8378

84-
1. Submit the batch inference pipeline and go to job detail page by selecting the job link in the left pane.
79+
1. Submit the batch inference pipeline.
8580

8681
## Publish your batch inference pipeline
8782

88-
Now you're ready to deploy the inference pipeline. This will deploy the pipeline and make it available for others to use.
83+
Now you're ready to deploy the inference pipeline. This deploys the pipeline and makes it available for others to use.
84+
85+
1. Select **Jobs** in the sidebar menu and select your running job.
8986

90-
1. Select the **Publish** button.
87+
1. Select the **Publish** button in the ribbon menu.
9188

92-
1. In the dialog that appears, expand the drop-down for **PipelineEndpoint**, and select **New PipelineEndpoint**.
89+
1. In the dialog that appears, **Create new**.
9390

9491
1. Provide an endpoint name and optional description.
9592

96-
Near the bottom of the dialog, you can see the parameter you configured with a default value of the dataset ID used during training.
93+
Near the bottom of the dialog, you can see the input you configured with a default value of the dataset ID used during training.
9794

9895
1. Select **Publish**.
9996

10097
:::image type="content" source="./media/how-to-run-batch-predictions-designer/publish-inference-pipeline.png" alt-text="Screenshot of set up published pipeline." lightbox= "./media/how-to-run-batch-predictions-designer/publish-inference-pipeline.png":::
10198

10299
## Consume an endpoint
103100

104-
Now, you have a published pipeline with a dataset parameter. The pipeline will use the trained model created in the training pipeline to score the dataset you provide as a parameter.
101+
Now, you have a published pipeline with a dataset parameter. The pipeline uses the trained model created in the training pipeline to score the dataset you provide as a parameter.
105102

106103
### Submit a pipeline job
107104

108-
In this section, you'll set up a manual pipeline job and alter the pipeline parameter to score new data.
105+
In this section, you set up a manual pipeline job and alter the pipeline parameter to score new data.
109106

110-
1. After the deployment is complete, go to the **Endpoints** section.
107+
1. After the deployment is complete, select **Pipelines** in the sidebar menu.
111108

112-
1. Select **Pipeline endpoints**.
109+
1. Select the **Pipeline endpoints** tab.
113110

114111
1. Select the name of the endpoint you created.
115112

116-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/manage-endpoints.png" alt-text="Screenshot of the pipeline endpoint tab." :::
113+
:::image type="content" source="./media/how-to-run-batch-predictions-designer/manage-endpoints.png" alt-text="Screenshot of the pipeline endpoint tab." :::
117114

118115
1. Select **Published pipelines**.
119116

@@ -122,13 +119,13 @@ In this section, you'll set up a manual pipeline job and alter the pipeline para
122119
1. Select the pipeline you published.
123120

124121
The pipeline details page shows you a detailed job history and connection string information for your pipeline.
125-
122+
126123
1. Select **Submit** to create a manual run of the pipeline.
127124

128125
:::image type="content" source="./media/how-to-run-batch-predictions-designer/submit-manual-run.png" alt-text="Screenshot of set up pipeline job with parameters highlighted." lightbox= "./media/how-to-run-batch-predictions-designer/submit-manual-run.png" :::
129-
126+
130127
1. Change the parameter to use a different dataset.
131-
128+
132129
1. Select **Submit** to run the pipeline.
133130

134131
### Use the REST endpoint
@@ -139,45 +136,43 @@ You can find the REST endpoint of a pipeline endpoint in the job overview panel.
139136

140137
You can also consume a published pipeline in the **Published pipelines** page. Select a published pipeline and you can find the REST endpoint of it in the **Published pipeline overview** panel to the right of the graph.
141138

142-
To make a REST call, you'll need an OAuth 2.0 bearer-type authentication header. See the following [tutorial section](../tutorial-pipeline-batch-scoring-classification.md#publish-and-run-from-a-rest-endpoint) for more detail on setting up authentication to your workspace and making a parameterized REST call.
139+
To make a REST call, you need an OAuth 2.0 bearer-type authentication header. See the following [tutorial section](../tutorial-pipeline-batch-scoring-classification.md#publish-and-run-from-a-rest-endpoint) for more detail on setting up authentication to your workspace and making a parameterized REST call.
143140

144141
## Versioning endpoints
145142

146-
The designer assigns a version to each subsequent pipeline that you publish to an endpoint. You can specify the pipeline version that you want to execute as a parameter in your REST call. If you don't specify a version number, the designer will use the default pipeline.
143+
The designer assigns a version to each subsequent pipeline that you publish to an endpoint. You can specify the pipeline version that you want to execute as a parameter in your REST call. If you don't specify a version number, the designer uses the default pipeline.
147144

148145
When you publish a pipeline, you can choose to make it the new default pipeline for that endpoint.
149146

150147
:::image type="content" source="./media/how-to-run-batch-predictions-designer/set-default-pipeline.png" alt-text="Screenshot of set up published pipeline with set as default pipeline for this endpoint checked." :::
151148

152149
You can also set a new default pipeline in the **Published pipelines** tab of your endpoint.
153150

154-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/set-new-default-pipeline.png" alt-text="Screenshot of sample pipeline tab with set as default highlighted." :::
155-
156151
## Update pipeline endpoint
157152

158153
If you make some modifications in your training pipeline, you might want to update the newly trained model to the pipeline endpoint.
159154

160155
1. After your modified training pipeline completes successfully, go to the job detail page.
161156

162-
1. Right click **Train Model** component and select **Register data**
157+
1. Right-click the **Train Model** component and select **Register data**.
163158

164159
:::image type="content" source="./media/how-to-run-batch-predictions-designer/register-train-model-as-dataset.png" alt-text="Screenshot of the train model component options with register data highlighted." lightbox= "./media/how-to-run-batch-predictions-designer/register-train-model-as-dataset.png" :::
165160

166-
Input name and select **File** type.
161+
Input a name and select a **File** type.
167162

168163
:::image type="content" source="./media/how-to-run-batch-predictions-designer/register-train-model-as-dataset-2.png" alt-text="Screenshot of register as data asset with new data asset selected." lightbox= "./media/how-to-run-batch-predictions-designer/register-train-model-as-dataset-2.png" :::
169164

170-
1. Find the previous batch inference pipeline draft, or you can just **Clone** the published pipeline into a new draft.
165+
1. Find the previous batch inference pipeline draft, or **Clone** the published pipeline into a new draft.
171166

172-
1. Replace the **MD-** node in the inference pipeline draft with the registered data in the step above.
167+
1. Replace the **MD-** node in the inference pipeline draft with the registered data in the preceding step.
173168

174-
:::image type="content" source="./media/how-to-run-batch-predictions-designer/update-inference-pipeline-draft.png" alt-text="Screenshot of updating the inference pipeline draft with the registered data in the step above." :::
169+
:::image type="content" source="./media/how-to-run-batch-predictions-designer/update-inference-pipeline-draft.png" alt-text="Screenshot of updating the inference pipeline draft with the registered data." :::
175170

176171
1. Updating data transformation node **TD-** is the same as the trained model.
177172

178-
1. Then you can submit the inference pipeline with the updated model and transformation, and publish again.
173+
1. Submit the inference pipeline with the updated model and transformation, and publish again.
179174

180-
## Next steps
175+
## Related content
181176

182-
* Follow the [designer tutorial to train and deploy a regression model](tutorial-designer-automobile-price-train-score.md).
183-
* For how to publish and run a published pipeline using the SDK v1, see the [How to deploy pipelines](how-to-deploy-pipelines.md?view=azureml-api-1&preserve-view=true) article.
177+
* [Tutorial: Train a no-code regression model using designer](tutorial-designer-automobile-price-train-score.md)
178+
* [Publish machine learning pipelines](how-to-deploy-pipelines.md?view=azureml-api-1&preserve-view=true)
-331 KB
Loading
-205 KB
Loading
-178 KB
Loading
-24.9 KB
Loading
-147 KB
Loading
-307 KB
Loading
-248 KB
Loading

0 commit comments

Comments
 (0)