You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-model-management-and-deployment.md
+3-32Lines changed: 3 additions & 32 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -79,7 +79,7 @@ Registered models are identified by name and version. Each time you register a m
79
79
> * When you use the **Filter by**`Tags` option on the **Models** page of Azure Machine Learning Studio, instead of using `TagName : TagValue`, use `TagName=TagValue` without spaces.
80
80
> * You can't delete a registered model that's being used in an active deployment.
81
81
82
-
For more information, [Work with models in Azure Machine Learning](how-to-manage-models.md).
82
+
For more information, [Work with models in Azure Machine Learning](./how-to-manage-models.md).
83
83
84
84
### Package and debug models
85
85
@@ -150,43 +150,16 @@ Machine Learning gives you the capability to track the end-to-end audit trail of
150
150
-[Machine Learning datasets](how-to-create-register-datasets.md) help you track, profile, and version data.
151
151
-[Interpretability](how-to-machine-learning-interpretability.md) allows you to explain your models, meet regulatory compliance, and understand how models arrive at a result for specific input.
152
152
- Machine Learning Job history stores a snapshot of the code, data, and computes used to train a model.
153
-
- The Machine Learning Model Registry captures all the metadata associated with your model. For example, metadata includes which experiment trained it, where it's being deployed, and if its deployments are healthy.
153
+
- The [Machine Learning Model Registry](./how-to-manage-models.md?tabs=use-local#create-a-model-in-the-model-registry) captures all the metadata associated with your model. For example, metadata includes which experiment trained it, where it's being deployed, and if its deployments are healthy.
154
154
-[Integration with Azure](how-to-use-event-grid.md) allows you to act on events in the machine learning lifecycle. Examples are model registration, deployment, data drift, and training (job) events.
155
155
156
156
> [!TIP]
157
157
> While some information on models and datasets is automatically captured, you can add more information by using _tags_. When you look for registered models and datasets in your workspace, you can use tags as a filter.
158
-
>
159
-
> Associating a dataset with a registered model is an optional step. For information on how to reference a dataset when you register a model, see the [Model](/python/api/azureml-core/azureml.core.model%28class%29) class reference.
160
158
161
159
## Notify, automate, and alert on events in the machine learning lifecycle
162
160
163
161
Machine Learning publishes key events to Azure Event Grid, which can be used to notify and automate on events in the machine learning lifecycle. For more information, see [Use Event Grid](how-to-use-event-grid.md).
164
162
165
-
## Monitor for operational and machine learning issues
166
-
167
-
Monitoring enables you to understand what data is being sent to your model, and the predictions that it returns.
168
-
169
-
This information helps you understand how your model is being used. The collected input data might also be useful in training future versions of the model.
170
-
171
-
For more information, see [Enable model data collection](v1/how-to-enable-data-collection.md).
172
-
173
-
## Retrain your model on new data
174
-
175
-
Often, you'll want to validate your model, update it, or even retrain it from scratch, as you receive new information. Sometimes, receiving new data is an expected part of the domain. Other times, as discussed in [Detect data drift (preview) on datasets](v1/how-to-monitor-datasets.md), model performance can degrade because of:
176
-
177
-
- Changes to a particular sensor.
178
-
- Natural data changes such as seasonal effects.
179
-
- Features shifting in their relation to other features.
180
-
181
-
There's no universal answer to "How do I know if I should retrain?" The Machine Learning event and monitoring tools previously discussed are good starting points for automation. After you've decided to retrain, you should:
182
-
183
-
- Preprocess your data by using a repeatable, automated process.
184
-
- Train your new model.
185
-
- Compare the outputs of your new model to the outputs of your old model.
186
-
- Use predefined criteria to choose whether to replace your old model.
187
-
188
-
A theme of the preceding steps is that your retraining should be automated, not improvised. [Machine Learning pipelines](concept-ml-pipelines.md) are a good answer for creating workflows that relate to data preparation, training, validation, and deployment. Read [Retrain models with Machine Learning designer](how-to-retrain-designer.md) to see how pipelines and the Machine Learning designer fit into a retraining scenario.
189
-
190
163
## Automate the machine learning lifecycle
191
164
192
165
You can use GitHub and Azure Pipelines to create a continuous integration process that trains a model. In a typical scenario, when a data scientist checks a change into the Git repo for a project, Azure Pipelines starts a training job. The results of the job can then be inspected to see the performance characteristics of the trained model. You can also create a pipeline that deploys the model as a web service.
@@ -199,10 +172,8 @@ The [Machine Learning extension](https://marketplace.visualstudio.com/items?item
199
172
For more information on using Azure Pipelines with Machine Learning, see:
200
173
201
174
*[Continuous integration and deployment of machine learning models with Azure Pipelines](/azure/devops/pipelines/targets/azure-machine-learning)
You can also use Azure Data Factory to create a data ingestion pipeline that prepares data for use with training. For more information, see [Data ingestion pipeline](v1/how-to-cicd-data-ingestion.md).
0 commit comments