You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
#Customer intent: As a data scientist, I want to know how to track my machine learning experiments and models with MLflow so I can understand what MLflow is and does so that I can use MLflow with my models.
14
15
---
15
16
16
17
# Track ML experiments and models with MLflow
17
18
18
-
19
-
In this article, you learn how to use MLflow for tracking your experiments and runs in Azure Machine Learning workspaces.
20
-
21
-
_Tracking_ is the process of saving relevant information about experiments that you run. The saved information (metadata) varies based on your project, and it can include:
19
+
In this article, you learn how to use MLflow for tracking experiments and runs in Azure Machine Learning workspaces. *Tracking* is the process of saving relevant information about experiments. The saved metadata varies by experiment, and can include:
22
20
23
21
- Code
24
-
- Environment details (such as OS version, Python packages)
22
+
- Environment details such as OS version and Python packages
25
23
- Input data
26
24
- Parameter configurations
27
25
- Models
28
26
- Evaluation metrics
29
-
- Evaluation visualizations (such as confusion matrices, importance plots)
30
-
- Evaluation results (including some evaluation predictions)
31
-
32
-
When you're working with jobs in Azure Machine Learning, Azure Machine Learning automatically tracks some information about your experiments, such as code, environment, and input and output data. However, for others like models, parameters, and metrics, the model builder needs to configure their tracking, as they're specific to the particular scenario.
33
-
34
-
> [!NOTE]
35
-
> If you want to track experiments that are running on Azure Databricks, see [Track Azure Databricks ML experiments with MLflow and Azure Machine Learning](how-to-use-mlflow-azure-databricks.md). To learn about tracking experiments that are running on Azure Synapse Analytics, see [Track Azure Synapse Analytics ML experiments with MLflow and Azure Machine Learning](how-to-use-mlflow-azure-synapse.md).
27
+
- Evaluation visualizations such as confusion matrices and importance plots
28
+
- Evaluation results, including some evaluation predictions
36
29
37
-
## Benefits of tracking experiments
30
+
When you work with jobs, Azure Machine Learning automatically tracks some information about experiments, such as code, environment, and input and output data. However, models, parameters, and metrics are specific to the scenario, so model builders must configure their tracking.
38
31
39
-
We strongly recommend that machine learning practitioners track experiments, whether you're training with jobs in Azure Machine Learning or training interactively in notebooks. Experiment tracking allows you to:
32
+
Whether you train with jobs in Azure Machine Learning or interactively in notebooks, experiment tracking helps you:
40
33
41
-
- Organize all of your machine learning experiments in a single place. You can then search and filter experiments and drill down to see details about the experiments you ran before.
42
-
-Compare experiments, analyze results, and debug model training with little extra work.
34
+
- Organize all of your machine learning experiments in a single place. You can then search and filter experiments and drill down to see details about previous experiments.
35
+
-Easily compare experiments, analyze results, and debug model training.
43
36
- Reproduce or rerun experiments to validate results.
44
-
- Improve collaboration, since you can see what other teammates are doing, share experiment results, and access experiment data programmatically.
37
+
- Improve collaboration, because you can see what other teammates are doing, share experiment results, and access experiment data programmatically.
45
38
46
-
## Why use MLflow for tracking experiments?
47
-
48
-
Azure Machine Learning workspaces are MLflow-compatible, which means you can use MLflow to track runs, metrics, parameters, and artifacts within your Azure Machine Learning workspaces. A major advantage of using MLflow for tracking is that you don't need to change your training routines to work with Azure Machine Learning or inject any cloud-specific syntax.
49
-
50
-
For more information about all supported MLflow and Azure Machine Learning functionalities, see [MLflow and Azure Machine Learning](concept-mlflow.md).
39
+
> [!NOTE]
40
+
> - To track experiments running on Azure Databricks, see [Track Azure Databricks ML experiments with MLflow and Azure Machine Learning](how-to-use-mlflow-azure-databricks.md).
41
+
> - To track experiments running on Azure Synapse Analytics, see [Track Azure Synapse Analytics ML experiments with MLflow and Azure Machine Learning](how-to-use-mlflow-azure-synapse.md).
51
42
52
-
## Limitations
43
+
Azure Machine Learning workspaces are MLflow-compatible. This compatibility means you can use MLflow to track runs, metrics, parameters, and artifacts in the workspaces without needing to change your training routines or inject any cloud-specific syntax. For more information about supported MLflow and Azure Machine Learning functionalities, see [MLflow and Azure Machine Learning](concept-mlflow.md).
53
44
54
-
Some methods available in the MLflow API might not be available when connected to Azure Machine Learning. For details about supported and unsupported operations, see [Support matrix for querying runs and experiments](how-to-track-experiments-mlflow.md#support-matrix-for-querying-runs-and-experiments).
45
+
>[!NOTE]
46
+
>Some methods available in the MLflow API might not be available when connected to Azure Machine Learning. For details about supported and unsupported operations, see [Support matrix for querying runs and experiments](how-to-track-experiments-mlflow.md#support-matrix-for-querying-runs-and-experiments).
55
47
56
48
## Prerequisites
57
49
58
-
-An Azure subscription. If you don't have an Azure subscription, create a free account before you begin. Try the [free or paid version of Azure Machine Learning](https://azure.microsoft.com/free/).
50
+
-Have an Azure subscription with the [free or paid version of Azure Machine Learning](https://azure.microsoft.com/free/).
MLflow organizes information in experiments and runs (_runs_ are called _jobs_ in Azure Machine Learning). By default, runs are logged to an experiment named __Default__ that is automatically created for you. You can configure the experiment where tracking is happening.
56
+
MLflow organizes information in experiments and runs. Runs are called *jobs* in Azure Machine Learning. By default, runs are logged to an experiment named **Default** that is automatically created for you. You can configure the experiment to track.
65
57
66
-
# [Working interactively](#tab/interactive)
58
+
# [Notebooks](#tab/interactive)
67
59
68
60
For interactive training, such as in a Jupyter notebook, use the MLflow command `mlflow.set_experiment()`. For example, the following code snippet configures an experiment:
To submit jobs, when using Azure Machine Learning CLI or SDK, set the experiment name by using the `experiment_name` property of the job. You don't have to configure it in your training script.
69
+
To submit jobs by using the Azure Machine Learning CLI or SDK, set the experiment name by using the `experiment_name` property of the job. You don't have to configure the experiment name in your training script.
Copy file name to clipboardExpand all lines: articles/machine-learning/includes/machine-learning-mlflow-prereqs.md
+10-10Lines changed: 10 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,19 +2,19 @@
2
2
author: santiagxf
3
3
ms.service: azure-machine-learning
4
4
ms.topic: include
5
-
ms.date: 08/08/2024
5
+
ms.date: 09/25/2024
6
6
ms.author: fasantia
7
7
---
8
8
9
-
- Install the MLflow SDK package `mlflow` and the Azure Machine Learning `azureml-mlflow`plug-in for MLflow:
9
+
- Install the MLflow SDK `mlflow`package and the Azure Machine Learning `azureml-mlflow`plugin for MLflow as follows:
10
10
11
-
```bash
12
-
pip install mlflow azureml-mlflow
13
-
```
14
-
15
-
> [!TIP]
16
-
> You can use the [`mlflow-skinny`](https://github.com/mlflow/mlflow/blob/master/README_SKINNY.rst) package, which is a lightweight MLflow package without SQL storage, server, UI, or data science dependencies. `mlflow-skinny` is recommended for users who primarily need the MLflow tracking and logging capabilities without importing the full suite of features, including deployments.
11
+
```bash
12
+
pip install mlflow azureml-mlflow
13
+
```
17
14
18
-
- An Azure Machine Learning workspace. To create a workspace, see the [Create machine learning resources tutorial](../quickstart-create-resources.md). Review the [access permissions you need to perform your MLflow operations in your workspace](../how-to-assign-roles.md#mlflow-operations).
15
+
> [!TIP]
16
+
> You can use the [`mlflow-skinny`](https://github.com/mlflow/mlflow/blob/master/README_SKINNY.rst) package, which is a lightweight MLflow package without SQL storage, server, UI, or data science dependencies. This package is recommended for users who primarily need the MLflow tracking and logging capabilities without importing the full suite of features, including deployments.
19
17
20
-
- If you perform remote tracking (that is, track experiments running outside Azure Machine Learning), configure MLflow to point to the tracking URI of your Azure Machine Learning workspace. For more information on how to connect MLflow to your workspace, see [Configure MLflow for Azure Machine Learning](../how-to-use-mlflow-configure-tracking.md).
18
+
- Create an Azure Machine Learning workspace. To create a workspace, see [Create resources you need to get started](../quickstart-create-resources.md). Review the [access permissions](../how-to-assign-roles.md#mlflow-operations) you need to perform your MLflow operations in your workspace.
19
+
20
+
- To do remote tracking, that is track experiments running outside Azure Machine Learning, configure MLflow to point to the tracking URI of your Azure Machine Learning workspace. For more information on how to connect MLflow to your workspace, see [Configure MLflow for Azure Machine Learning](../how-to-use-mlflow-configure-tracking.md).
0 commit comments