Skip to content

Commit 995ed7a

Browse files
Merge pull request #212365 from Blackmist/v2-mlops-updates
Suggestions for MLOPs article
2 parents e493465 + e98d053 commit 995ed7a

File tree

1 file changed

+3
-32
lines changed

1 file changed

+3
-32
lines changed

articles/machine-learning/concept-model-management-and-deployment.md

Lines changed: 3 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -79,7 +79,7 @@ Registered models are identified by name and version. Each time you register a m
7979
> * When you use the **Filter by** `Tags` option on the **Models** page of Azure Machine Learning Studio, instead of using `TagName : TagValue`, use `TagName=TagValue` without spaces.
8080
> * You can't delete a registered model that's being used in an active deployment.
8181
82-
For more information, [Work with models in Azure Machine Learning](how-to-manage-models.md).
82+
For more information, [Work with models in Azure Machine Learning](./how-to-manage-models.md).
8383

8484
### Package and debug models
8585

@@ -150,43 +150,16 @@ Machine Learning gives you the capability to track the end-to-end audit trail of
150150
- [Machine Learning datasets](how-to-create-register-datasets.md) help you track, profile, and version data.
151151
- [Interpretability](how-to-machine-learning-interpretability.md) allows you to explain your models, meet regulatory compliance, and understand how models arrive at a result for specific input.
152152
- Machine Learning Job history stores a snapshot of the code, data, and computes used to train a model.
153-
- The Machine Learning Model Registry captures all the metadata associated with your model. For example, metadata includes which experiment trained it, where it's being deployed, and if its deployments are healthy.
153+
- The [Machine Learning Model Registry](./how-to-manage-models.md?tabs=use-local#create-a-model-in-the-model-registry) captures all the metadata associated with your model. For example, metadata includes which experiment trained it, where it's being deployed, and if its deployments are healthy.
154154
- [Integration with Azure](how-to-use-event-grid.md) allows you to act on events in the machine learning lifecycle. Examples are model registration, deployment, data drift, and training (job) events.
155155

156156
> [!TIP]
157157
> While some information on models and datasets is automatically captured, you can add more information by using _tags_. When you look for registered models and datasets in your workspace, you can use tags as a filter.
158-
>
159-
> Associating a dataset with a registered model is an optional step. For information on how to reference a dataset when you register a model, see the [Model](/python/api/azureml-core/azureml.core.model%28class%29) class reference.
160158
161159
## Notify, automate, and alert on events in the machine learning lifecycle
162160

163161
Machine Learning publishes key events to Azure Event Grid, which can be used to notify and automate on events in the machine learning lifecycle. For more information, see [Use Event Grid](how-to-use-event-grid.md).
164162

165-
## Monitor for operational and machine learning issues
166-
167-
Monitoring enables you to understand what data is being sent to your model, and the predictions that it returns.
168-
169-
This information helps you understand how your model is being used. The collected input data might also be useful in training future versions of the model.
170-
171-
For more information, see [Enable model data collection](v1/how-to-enable-data-collection.md).
172-
173-
## Retrain your model on new data
174-
175-
Often, you'll want to validate your model, update it, or even retrain it from scratch, as you receive new information. Sometimes, receiving new data is an expected part of the domain. Other times, as discussed in [Detect data drift (preview) on datasets](v1/how-to-monitor-datasets.md), model performance can degrade because of:
176-
177-
- Changes to a particular sensor.
178-
- Natural data changes such as seasonal effects.
179-
- Features shifting in their relation to other features.
180-
181-
There's no universal answer to "How do I know if I should retrain?" The Machine Learning event and monitoring tools previously discussed are good starting points for automation. After you've decided to retrain, you should:
182-
183-
- Preprocess your data by using a repeatable, automated process.
184-
- Train your new model.
185-
- Compare the outputs of your new model to the outputs of your old model.
186-
- Use predefined criteria to choose whether to replace your old model.
187-
188-
A theme of the preceding steps is that your retraining should be automated, not improvised. [Machine Learning pipelines](concept-ml-pipelines.md) are a good answer for creating workflows that relate to data preparation, training, validation, and deployment. Read [Retrain models with Machine Learning designer](how-to-retrain-designer.md) to see how pipelines and the Machine Learning designer fit into a retraining scenario.
189-
190163
## Automate the machine learning lifecycle
191164

192165
You can use GitHub and Azure Pipelines to create a continuous integration process that trains a model. In a typical scenario, when a data scientist checks a change into the Git repo for a project, Azure Pipelines starts a training job. The results of the job can then be inspected to see the performance characteristics of the trained model. You can also create a pipeline that deploys the model as a web service.
@@ -199,10 +172,8 @@ The [Machine Learning extension](https://marketplace.visualstudio.com/items?item
199172
For more information on using Azure Pipelines with Machine Learning, see:
200173

201174
* [Continuous integration and deployment of machine learning models with Azure Pipelines](/azure/devops/pipelines/targets/azure-machine-learning)
202-
* [Machine Learning MLOps](https://aka.ms/mlops) repository
203-
* [Machine Learning MLOpsPython](https://github.com/Microsoft/MLOpspython) repository
175+
* [Machine Learning MLOps](https://github.com/Azure/mlops-v2) repository
204176

205-
You can also use Azure Data Factory to create a data ingestion pipeline that prepares data for use with training. For more information, see [Data ingestion pipeline](v1/how-to-cicd-data-ingestion.md).
206177

207178
## Next steps
208179

0 commit comments

Comments
 (0)