You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In this article, you'll learn how to programmatically schedule a pipeline to run on Azure. You can create a schedule based on elapsed time or on file-system changes. You can use time-based schedules to accomplish routine tasks, such as monitoring for data drift. You can use change-based schedules to react to irregular or unpredictable changes, such as new data being uploaded or old data being edited. After you learn how to create schedules, you'll learn how to retrieve and deactivate them. Finally, you'll learn how to use other Azure services, Azure Logic Apps and Azure Data Factory, to run pipelines. A logic app enables more complex triggering logic or behavior. Azure Data Factory pipelines allow you to call a machine learning pipeline as part of a larger data orchestration pipeline.
23
+
In this article, you'll learn how to programmatically schedule a pipeline to run on Azure. You can create a schedule based on elapsed time or on file-system changes. You can use time-based schedules to accomplish routine tasks, such as monitoring for data drift. You can use change-based schedules to react to irregular or unpredictable changes, such as new data being uploaded or old data being edited.
24
+
25
+
After you learn how to create schedules, you'll learn how to retrieve and deactivate them. Finally, you'll learn how to use other Azure services, Azure Logic Apps and Azure Data Factory, to run pipelines. A logic app enables more complex triggering logic or behavior. Azure Data Factory pipelines allow you to call a machine learning pipeline as part of a larger data orchestration pipeline.
To run a pipeline on a recurring basis, you create a schedule. A `Schedule` associates a pipeline, an experiment, and a trigger. The trigger can either be a`ScheduleRecurrence` that defines the wait time between jobs or a datastore path that specifies a directory to watch for changes. In either case, you need the pipeline identifier and the name of the experiment in which to create the schedule.
61
+
To run a pipeline on a recurring basis, you create a schedule. A `Schedule` associates a pipeline, an experiment, and a trigger. The trigger can either be a`ScheduleRecurrence` that defines the wait time between jobs or a datastore path that specifies a directory to watch for changes. In either case, you need the pipeline identifier and the name of the experiment in which to create the schedule.
60
62
61
63
At the top of your Python file, import the `Schedule` and `ScheduleRecurrence` classes:
62
64
@@ -67,7 +69,7 @@ from azureml.pipeline.core.schedule import ScheduleRecurrence, Schedule
67
69
68
70
### Create a time-based schedule
69
71
70
-
The `ScheduleRecurrence` constructor has a required `frequency` argument that must be set to one of the following strings: `"Minute"`, `"Hour"`, `"Day"`, `"Week"`, or `"Month"`. It also requires an integer `interval` argument that specifies how many `frequency` units should elapse between start times. Optional arguments allow you to be more specific about starting times, as described in the [ScheduleRecurrence SDK documentation](/python/api/azureml-pipeline-core/azureml.pipeline.core.schedule.schedulerecurrence).
72
+
The `ScheduleRecurrence` constructor has a required `frequency` argument that must be set to one of the following strings: `"Minute"`, `"Hour"`, `"Day"`, `"Week"`, or `"Month"`. It also requires an integer `interval` argument that specifies how many `frequency` units should elapse between start times. Optional arguments allow you to be more specific about starting times, as described in the [ScheduleRecurrence documentation](/python/api/azureml-pipeline-core/azureml.pipeline.core.schedule.schedulerecurrence).
71
73
72
74
Create a `Schedule` that begins a job every 15 minutes:
73
75
@@ -106,15 +108,15 @@ In addition to the arguments discussed previously, you can set the `status` argu
106
108
107
109
## View your scheduled pipelines
108
110
109
-
In a browser, go to Azure Machine Learning studio. In the left pane, select the Endpoints icon. In the **Endpoints** pane, select **Run-time endpoints**. This takes you to a list of the pipelines that are published in the workspace.
111
+
In a browser, go to Azure Machine Learning studio. In the left pane, select the Endpoints icon. In the **Endpoints** pane, select **Real-time endpoints**. This takes you to a list of the pipelines that are published in the workspace.
110
112
111
113
:::image type="content" source="./media/how-to-trigger-published-pipeline/scheduled-pipelines.png" alt-text="Screenshot that shows the Endpoints pane." lightbox="./media/how-to-trigger-published-pipeline/scheduled-pipelines.png":::
112
114
113
115
On this page, you can see summary information about all the pipelines in the workspace: names, descriptions, status, and so on. You can get more information by selecting the name of a pipeline. On the resulting page, you can also get information about individual jobs.
114
116
115
117
## Deactivate the pipeline
116
118
117
-
If you have a `Pipeline` that's published but not scheduled, you can disable it with this code:
119
+
If you have a `Pipeline` that's published but not scheduled, you can disable it by using this code:
Now create a [logic app](/azure/logic-apps/logic-apps-overview) instance. After your logic app is provisioned, use these steps to configure a trigger for your pipeline:
162
+
Now create a [logic app](/azure/logic-apps/logic-apps-overview). After your logic app is provisioned, use these steps to configure a trigger for your pipeline:
161
163
162
164
1.[Create a system-assigned managed identity](/azure/logic-apps/create-managed-service-identity) to give the app access to your Azure Machine Learning workspace.
163
165
@@ -195,7 +197,7 @@ Now create a [logic app](/azure/logic-apps/logic-apps-overview) instance. After
195
197
|---|---|
196
198
|**URI**|The endpoint of the published pipeline. See [Prerequisites](#prerequisites). |
197
199
|**Method**|**POST**|
198
-
| Authentication type (under **Advanced settings**) |**Managed Identity**|
1. Configure your schedule to set the values of any [DataPath PipelineParameters](https://github.com/Azure/MachineLearningNotebooks/blob/master/how-to-use-azureml/machine-learning-pipelines/intro-to-pipelines/aml-pipelines-showcasing-datapath-and-pipelineparameter.ipynb) that you have:
201
203
@@ -227,7 +229,7 @@ Now create a [logic app](/azure/logic-apps/logic-apps-overview) instance. After
227
229
228
230
## Call machine learning pipelines from Azure Data Factory pipelines
229
231
230
-
In an Azure Data Factory pipeline, the *Machine Learning Execute Pipeline* activity runs an Azure Machine Learning pipeline. You can find this activity on the Azure Data Factory authoring page under **Machine Learning** in the menu:
232
+
In an Azure Data Factory pipeline, the **Machine Learning Execute Pipeline** activity runs an Azure Machine Learning pipeline. You can find this activity on the Azure Data Factory authoring page under **Machine Learning** in the menu:
231
233
232
234
:::image type="content" source="./media/how-to-trigger-published-pipeline/azure-data-factory-pipeline-activity.png" alt-text="Screenshot showing the machine learning pipeline activity in the Azure Data Factory authoring environment." lightbox="./media/how-to-trigger-published-pipeline/azure-data-factory-pipeline-activity.png":::
0 commit comments