You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-model-management-and-deployment.md
+26-9Lines changed: 26 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,22 +9,31 @@ ms.topic: conceptual
9
9
ms.reviewer: jmartens
10
10
author: jpe316
11
11
ms.author: jordane
12
-
ms.date: 11/22/2019
12
+
ms.date: 02/21/2020
13
13
ms.custom: seodec18
14
14
---
15
15
16
-
# MLOps: Model management, deployment and monitoring with Azure Machine Learning
16
+
# MLOps: Model management, deployment, and monitoring with Azure Machine Learning
17
17
18
18
In this article, learn about how to use Azure Machine Learning to manage the lifecycle of your models. Azure Machine Learning uses a Machine Learning Operations (MLOps) approach. MLOps improves the quality and consistency of your machine learning solutions.
19
19
20
+
## What is MLOps?
21
+
22
+
Machine Learning Operations (MLOps) is based on [DevOps](https://azure.microsoft.com/overview/what-is-devops/) principles and practices that increase the efficiency of workflows. For example, continuous integration, delivery, and deployment. MLOps applies these principals to the machine learning process, with the goal of:
23
+
24
+
* Faster experimentation and development of models
25
+
* Faster deployment of models into production
26
+
* Quality assurance
27
+
20
28
Azure Machine Learning provides the following MLOps capabilities:
21
29
22
-
-**Create reproducible ML pipelines**. Pipelines allow you to define repeatable and reusable steps for your data preparation, training, and scoring processes.
23
-
-**Register, package, and deploy models from anywhere** and track associated metadata required to use the model.
24
-
-**Capture the governance data required for capturing the end-to-end ML lifecycle**, including who is publishing models, why changes are being made, and when models were deployed or used in production.
25
-
-**Notify and alert on events in the ML lifecycle** such as experiment completion, model registration, model deployment, and data drift detection.
30
+
-**Create reproducible ML pipelines**. Machine Learning pipelines allow you to define repeatable and reusable steps for your data preparation, training, and scoring processes.
31
+
-**Create reusable software environments** for training and deploying models.
32
+
-**Register, package, and deploy models from anywhere**. You can also track associated metadata required to use the model.
33
+
-**Capture the governance data for the end-to-end ML lifecycle**. The logged information can include who is publishing models, why changes were made, and when models were deployed or used in production.
34
+
-**Notify and alert on events in the ML lifecycle**. For example, experiment completion, model registration, model deployment, and data drift detection.
26
35
-**Monitor ML applications for operational and ML-related issues**. Compare model inputs between training and inference, explore model-specific metrics, and provide monitoring and alerts on your ML infrastructure.
27
-
-**Automate the end-to-end ML lifecycle with Azure Machine Learning and Azure DevOps** to frequently update models, test new models, and continuously roll out new ML models alongside your other applications and services.
36
+
-**Automate the end-to-end ML lifecycle with Azure Machine Learning and Azure Pipelines**. Using pipelines allows you to frequently update models, test new models, and continuously roll out new ML models alongside your other applications and services.
28
37
29
38
## Create reproducible ML pipelines
30
39
@@ -34,6 +43,12 @@ An ML pipeline can contain steps from data preparation to feature extraction to
34
43
35
44
If you use the [Designer](concept-designer.md) to create your ML pipelines, you may at any time click the **"..."** at the top-right of the Designer page and then select **Clone**. Cloning your pipeline allows you to iterate your pipeline design without losing your old versions.
36
45
46
+
## Create reusable software environments
47
+
48
+
Azure Machine Learning environments allow you to track and reproduce your projects' software dependencies as they evolve. Environments allow you to ensure that builds are reproducible without manual software configurations.
49
+
50
+
Environments describe the pip and Conda dependencies for your projects, and can be used for both training and deployment of models. For more information, see [What are Azure Machine Learning environments](concept-environments.md).
51
+
37
52
## Register, package, and deploy models from anywhere
38
53
39
54
### Register and track ML models
@@ -77,7 +92,7 @@ When using a model as a web service or IoT Edge device, you provide the followin
77
92
78
93
* The model(s) that are used to score data submitted to the service/device.
79
94
* An entry script. This script accepts requests, uses the model(s) to score the data, and return a response.
80
-
*A conda environment file that describes the dependencies required by the model(s) and entry script.
95
+
*An Azure Machine Learning environment that describes the pip and Conda dependencies required by the model(s) and entry script.
81
96
* Any additional assets such as text, data, etc. that are required by the model(s) and entry script.
82
97
83
98
You also provide the configuration of the target deployment platform. For example, the VM family type, available memory, and number of cores when deploying to Azure Kubernetes Service.
@@ -119,7 +134,7 @@ Azure ML gives you the capability to track the end-to-end audit trail of all of
119
134
120
135
- Azure ML [integrates with Git](how-to-set-up-training-targets.md#gitintegration) to track information on which repository / branch / commit your code came from.
121
136
-[Azure ML Datasets](how-to-create-register-datasets.md) help you track, profile, and version data.
122
-
- Azure ML Run history stores a snapshot of the code, data, and compute used to train a model.
137
+
- Azure ML Run history stores a snapshot of the code, data, and computes used to train a model.
123
138
- The Azure ML Model Registry captures all of the metadata associated with your model (which experiment trained it, where it is being deployed, if its deployments are healthy).
124
139
125
140
## Notify, automate, and alert on events in the ML lifecycle
@@ -158,6 +173,8 @@ The [Azure Machine Learning extension](https://marketplace.visualstudio.com/item
158
173
159
174
For more information on using Azure Pipelines with Azure Machine Learning, see the [Continuous integration and deployment of ML models with Azure Pipelines](/azure/devops/pipelines/targets/azure-machine-learning) article and the [Azure Machine Learning MLOps](https://aka.ms/mlops) repository.
160
175
176
+
You can also use Azure Data Factory to create a data ingestion pipeline that prepares data for use with training. For more information, see [Data ingestion pipeline](how-to-cicd-data-ingestion.md).
177
+
161
178
## Next steps
162
179
163
180
Learn more by reading and exploring the following resources:
0 commit comments