You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-use-batch-endpoints-studio.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -118,7 +118,7 @@ To change where the results are stored, providing a blob store and output path w
118
118
119
119
### Summary of all submitted jobs
120
120
121
-
To see a summary of all the submitted jobs for an endpoint, select the endpoint and then select the **Runs** tab.
121
+
To see a summary of all the submitted jobs for an endpoint, select the endpoint and then select the **Jobs** tab.
122
122
123
123
:::image type="content" source="media/how-to-use-batch-endpoints-studio/summary-jobs.png" alt-text="Screenshot of summary of jobs submitted to a batch endpoint":::
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-use-managed-identities.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -73,7 +73,7 @@ az ml workspace create -w <workspace name> \
73
73
74
74
### Let Azure Machine Learning service create workspace ACR
75
75
76
-
If you don't bring your own ACR, Azure Machine Learning service will create one for you when you perform an operation that needs one. For example, submit a training run to Machine Learning Compute, build an environment, or deploy a web service endpoint. The ACR created by the workspace will have admin user enabled, and you need to disable the admin user manually.
76
+
If you don't bring your own ACR, Azure Machine Learning service will create one for you when you perform an operation that needs one. For example, submit a training job to Machine Learning Compute, build an environment, or deploy a web service endpoint. The ACR created by the workspace will have admin user enabled, and you need to disable the admin user manually.
Finally, when submitting a training run, specify the base image location in the [environment definition](how-to-use-environments.md#use-existing-environments).
174
+
Finally, when submitting a training job, specify the base image location in the [environment definition](how-to-use-environments.md#use-existing-environments).
In this article, learn how to enable MLflow to connect to Azure Machine Learning while working in an Azure Databricks workspace. You can leverage this configuration for tracking, model management and model deployment.
19
19
20
-
[MLflow](https://www.mlflow.org) is an open-source library for managing the life cycle of your machine learning experiments. MLFlow Tracking is a component of MLflow that logs and tracks your training run metrics and model artifacts. Learn more about [Azure Databricks and MLflow](/azure/databricks/applications/mlflow/).
20
+
[MLflow](https://www.mlflow.org) is an open-source library for managing the life cycle of your machine learning experiments. MLFlow Tracking is a component of MLflow that logs and tracks your training job metrics and model artifacts. Learn more about [Azure Databricks and MLflow](/azure/databricks/applications/mlflow/).
21
21
22
22
See [MLflow and Azure Machine Learning](concept-mlflow.md) for additional MLflow and Azure Machine Learning functionality integrations.
23
23
@@ -30,6 +30,7 @@ If you have an MLflow Project to train with Azure Machine Learning, see [Train M
30
30
*[Create an Azure Machine Learning Workspace](quickstart-create-resources.md).
31
31
* See which [access permissions you need to perform your MLflow operations with your workspace](how-to-assign-roles.md#mlflow-operations).
32
32
33
+
33
34
## Install libraries
34
35
35
36
To install libraries on your cluster, navigate to the **Libraries** tab and select **Install New**
@@ -167,10 +168,13 @@ When MLflow is configured to exclusively track experiments in Azure Machine Lear
In your training script, import`mlflow` to use the MLflow logging APIs, and start logging your job metrics. The following example, logs the epoch loss metric.
172
+
170
173
## Logging models with MLflow
171
174
172
175
After your model is trained, you can log it to the tracking server with the `mlflow.<model_flavor>.log_model()` method. `<model_flavor>`, refers to the framework associated with the model. [Learn what model flavors are supported](https://mlflow.org/docs/latest/models.html#model-api). In the following example, a model created with the Spark library MLLib is being registered:
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-use-mlflow-cli-runs.md
+15-5Lines changed: 15 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -22,15 +22,15 @@ ms.devlang: azurecli
22
22
23
23
In this article, learn how to enable [MLflow Tracking](https://mlflow.org/docs/latest/quickstart.html#using-the-tracking-api) to connect Azure Machine Learning as the backend of your MLflow experiments.
24
24
25
-
[MLflow](https://www.mlflow.org) is an open-source library for managing the lifecycle of your machine learning experiments. MLflow Tracking is a component of MLflow that logs and tracks your training run metrics and model artifacts, no matter your experiment's environment--locally on your computer, on a remote compute target, a virtual machine, or an [Azure Databricks cluster](how-to-use-mlflow-azure-databricks.md).
25
+
[MLflow](https://www.mlflow.org) is an open-source library for managing the lifecycle of your machine learning experiments. MLflow Tracking is a component of MLflow that logs and tracks your training job metrics and model artifacts, no matter your experiment's environment--locally on your computer, on a remote compute target, a virtual machine, or an [Azure Databricks cluster](how-to-use-mlflow-azure-databricks.md).
26
26
27
27
See [MLflow and Azure Machine Learning](concept-mlflow.md) for all supported MLflow and Azure Machine Learning functionality including MLflow Project support (preview) and model deployment.
28
28
29
29
> [!IMPORTANT]
30
30
> When using the Azure Machine Learning SDK v2, no native logging is provided. Instead, use MLflow's tracking capabilities. For more information, see [How to log and view metrics (v2)](how-to-log-view-metrics.md).
31
31
32
32
> [!TIP]
33
-
> The information in this document is primarily for data scientists and developers who want to monitor the model training process. If you are an administrator interested in monitoring resource usage and events from Azure Machine Learning, such as quotas, completed training runs, or completed model deployments, see [Monitoring Azure Machine Learning](monitor-azure-machine-learning.md).
33
+
> The information in this document is primarily for data scientists and developers who want to monitor the model training process. If you are an administrator interested in monitoring resource usage and events from Azure Machine Learning, such as quotas, completed training jobs, or completed model deployments, see [Monitoring Azure Machine Learning](monitor-azure-machine-learning.md).
34
34
35
35
> [!NOTE]
36
36
> You can use the [MLflow Skinny client](https://github.com/mlflow/mlflow/blob/master/README_SKINNY.rst) which is a lightweight MLflow package without SQL storage, server, UI, or data science dependencies. This is recommended for users who primarily need the tracking and logging capabilities without importing the full suite of MLflow features including deployments.
@@ -44,6 +44,7 @@ See [MLflow and Azure Machine Learning](concept-mlflow.md) for all supported MLf
44
44
* Install and [set up CLI (v2)](how-to-configure-cli.md#prerequisites) and make sure you install the ml extension.
45
45
* Install and set up SDK(v2) for Python
46
46
47
+
47
48
## Track runs from your local machine or remote compute
48
49
49
50
Tracking using MLflow with Azure Machine Learning lets you store the logged metrics and artifacts runs that were executed on your local machine into your Azure Machine Learning workspace.
@@ -52,6 +53,7 @@ Tracking using MLflow with Azure Machine Learning lets you store the logged metr
52
53
53
54
To track a run that is not running on Azure Machine Learning compute (from now on referred to as *"local compute"*), you need to point your local compute to the Azure Machine Learning MLflow Tracking URI.
54
55
56
+
55
57
> [!NOTE]
56
58
> When running on Azure Compute (Azure Notebooks, Jupyter Notebooks hosted on Azure Compute Instances or Compute Clusters) you don't have to configure the tracking URI. It's automatically configured for you.
57
59
@@ -119,6 +121,7 @@ export MLFLOW_TRACKING_URI=$(az ml workspace show --query mlflow_tracking_uri |
119
121
120
122
The Azure Machine Learning Tracking URI can be constructed using the subscription ID, region of where the resource is deployed, resource group name and workspace name. The following code sample shows how:
121
123
124
+
122
125
```python
123
126
import mlflow
124
127
@@ -157,9 +160,9 @@ You can also set one of the MLflow environment variables [MLFLOW_EXPERIMENT_NAME
After you set the MLflow experiment name, you can start your training runwith`start_run()`. Then use `log_metric()` to activate the MLflow logging APIand begin logging your training run metrics.
165
+
After you set the MLflow experiment name, you can start your training jobwith`start_run()`. Then use `log_metric()` to activate the MLflow logging APIand begin logging your training job metrics.
163
166
164
167
```Python
165
168
import os
@@ -172,21 +175,25 @@ with mlflow.start_run() as mlflow_run:
172
175
mlflow.log_artifact("helloworld.txt")
173
176
```
174
177
178
+
175
179
For details about how to log metrics, parameters and artifacts in a run using MLflow view [How to log and view metrics](how-to-log-view-metrics.md).
Remote runs (jobs) let you train your models in a more robust and repetitive way. They can also leverage more powerful computes, such as Machine Learning Compute clusters. See [Use compute targets for model training](how-to-set-up-training-targets.md) to learn about different compute options.
182
187
188
+
183
189
When submitting runs using jobs, Azure Machine Learning automatically configures MLflow to work with the workspace the job is running in. This means that there is no need to configure the MLflow tracking URI. On top of that, experiments are automatically named based on the details of the job.
184
190
185
191
> [!IMPORTANT]
186
192
> When submitting training jobs to Azure Machine Learning, you don't have to configure the MLflow tracking URI on your training logic as it is already configured for you.
187
193
188
194
### Creating a training routine
189
195
196
+
190
197
First, you should create a `src` subdirectory and create a filewith your training code in a `hello_world.py`filein the `src` subdirectory. All your training code will go into the `src` subdirectory, including `train.py`.
191
198
192
199
The training code is taken from this [MLfLow example](https://github.com/Azure/azureml-examples/blob/main/cli/jobs/basics/src/hello-mlflow.py) in the Azure Machine Learning example repo.
@@ -195,13 +202,15 @@ Copy this code into the file:
> Note how this sample don't contains the instructions `mlflow.start_run` nor `mlflow.set_experiment`. This is automatically done by Azure Machine Learning.
200
208
201
209
### Submitting the job
202
210
203
211
Use the [Azure Machine Learning CLI (v2)](how-to-train-cli.md) to submit a remote run. When using the Azure Machine Learning CLI (v2), the MLflow tracking URIand experiment name are set automatically and directs the logging from MLflow to your workspace. Learn more about [logging Azure Machine Learning CLI (v2) experiments with MLflow](how-to-train-cli.md#model-tracking-with-mlflow)
204
212
213
+
205
214
Create a YAMLfilewith your job definition in a `job.yml`file. This file should be created outside the `src` directory. Copy this code into the file:
To view the artifacts of a run, you can use [MlFlowClient.list_artifacts()](https://mlflow.org/docs/latest/python_api/mlflow.tracking.html#mlflow.tracking.MlflowClient.list_artifacts)
0 commit comments