You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-use-mlflow-azure-databricks.md
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -23,8 +23,8 @@ In this article, you learn:
23
23
> [!div class="checklist"]
24
24
> - The required libraries needed to use MLflow with Azure Databricks and Azure Machine Learning.
25
25
> - How to [track Azure Databricks runs with MLflow in Azure Machine Learning](#track-azure-databricks-runs-with-mlflow).
26
-
> - How to [log models with MLflow](#registering-models-in-the-registry-with-mlflow) to get them registered in Azure Machine Learning.
27
-
> - How to [deploy and consume models registered in Azure Machine Learning](#deploying-and-consuming-models-registered-in-azure-machine-learning).
26
+
> - How to [log models with MLflow](#register-models-in-the-registry-with-mlflow) to get them registered in Azure Machine Learning.
27
+
> - How to [deploy and consume models registered in Azure Machine Learning](#deploy-and-consume-models-registered-in-azure-machine-learning).
28
28
29
29
## Prerequisites
30
30
@@ -54,18 +54,18 @@ To install libraries on your cluster:
54
54
55
55
You can configure Azure Databricks to track experiments using MLflow in two ways:
56
56
57
-
-[Track in both Azure Databricks workspace and Azure Machine Learning workspace (dual-tracking)](#dual-tracking-on-azure-databricks-and-azure-machine-learning)
58
-
-[Track exclusively on Azure Machine Learning](#tracking-exclusively-on-azure-machine-learning-workspace)
57
+
-[Track in both Azure Databricks workspace and Azure Machine Learning workspace (dual-tracking)](#dual-track-on-azure-databricks-and-azure-machine-learning)
58
+
-[Track exclusively on Azure Machine Learning](#track-exclusively-on-azure-machine-learning-workspace)
59
59
60
60
By default, when you link your Azure Databricks workspace, dual-tracking is configured for you.
61
61
62
62
### Dual-track on Azure Databricks and Azure Machine Learning
63
63
64
64
Linking your Azure Databricks workspace to your Azure Machine Learning workspace enables you to track your experiment data in the Azure Machine Learning workspace and Azure Databricks workspace at the same time. This configuration is called *Dual-tracking*.
65
65
66
-
Dual-tracking in a [private link enabled Azure Machine Learning workspace](how-to-configure-private-link.md) isn't currently supported. Configure [exclusive tracking with your Azure Machine Learning workspace](#tracking-exclusively-on-azure-machine-learning-workspace) instead.
66
+
Dual-tracking in a [private link enabled Azure Machine Learning workspace](how-to-configure-private-link.md) isn't currently supported. Configure [exclusive tracking with your Azure Machine Learning workspace](#track-exclusively-on-azure-machine-learning-workspace) instead.
67
67
68
-
Dual-tracking isn't currently supported in Microsoft Azure operated by 21Vianet. Configure [exclusive tracking with your Azure Machine Learning workspace](#tracking-exclusively-on-azure-machine-learning-workspace) instead.
68
+
Dual-tracking isn't currently supported in Microsoft Azure operated by 21Vianet. Configure [exclusive tracking with your Azure Machine Learning workspace](#track-exclusively-on-azure-machine-learning-workspace) instead.
69
69
70
70
To link your Azure Databricks workspace to a new or existing Azure Machine Learning workspace:
71
71
@@ -94,7 +94,7 @@ with mlflow.start_run():
94
94
```
95
95
96
96
> [!NOTE]
97
-
> As opposed to tracking, model registries don't support registering models at the same time on both Azure Machine Learning and Azure Databricks. For more information, see [Registering models in the registry with MLflow](#registering-models-in-the-registry-with-mlflow).
97
+
> As opposed to tracking, model registries don't support registering models at the same time on both Azure Machine Learning and Azure Databricks. For more information, see [Register models in the registry with MLflow](#registering-models-in-the-registry-with-mlflow).
98
98
99
99
### Track exclusively on Azure Machine Learning workspace
100
100
@@ -260,11 +260,11 @@ The flavor `spark` doesn't correspond to the fact that you're training a model i
260
260
Models are logged inside of the run being tracked. That fact means that models are available in either both Azure Databricks and Azure Machine Learning (default) or exclusively in Azure Machine Learning if you configured the tracking URI to point to it.
261
261
262
262
> [!IMPORTANT]
263
-
> The parameter `registered_model_name` has not been specified. For more information about this parameter and the registry, see [Registering models in the registry with MLflow](#registering-models-in-the-registry-with-mlflow).
263
+
> The parameter `registered_model_name` has not been specified. For more information about this parameter and the registry, see [Registering models in the registry with MLflow](#register-models-in-the-registry-with-mlflow).
264
264
265
265
## Register models in the registry with MLflow
266
266
267
-
As opposed to tracking, model registries can't operate at the same timein Azure Databricks and Azure Machine Learning. They have to use either one or the other. By default, model registries use the Azure Databricks workspace. If you choose to [set MLflow tracking to only track in your Azure Machine Learning workspace](#tracking-exclusively-on-azure-machine-learning-workspace), the model registry is the Azure Machine Learning workspace.
267
+
As opposed to tracking, model registries can't operate at the same timein Azure Databricks and Azure Machine Learning. They have to use either one or the other. By default, model registries use the Azure Databricks workspace. If you choose to [set MLflow tracking to only track in your Azure Machine Learning workspace](#track-exclusively-on-azure-machine-learning-workspace), the model registry is the Azure Machine Learning workspace.
268
268
269
269
If you use the default configuration, the following code logs a model inside the corresponding runs of both Azure Databricks and Azure Machine Learning, but it registers it only on Azure Databricks.
### Use Azure Machine Learning registry with MLflow
280
280
281
-
If you want to use Azure Machine Learning Model Registry instead of Azure Databricks, we recommend that you [set MLflow tracking to only track in your Azure Machine Learning workspace](#tracking-exclusively-on-azure-machine-learning-workspace). This approach removes the ambiguity of where models are being registered and simplifies the configuration.
281
+
If you want to use Azure Machine Learning Model Registry instead of Azure Databricks, we recommend that you [set MLflow tracking to only track in your Azure Machine Learning workspace](#track-exclusively-on-azure-machine-learning-workspace). This approach removes the ambiguity of where models are being registered and simplifies the configuration.
282
282
283
283
If you want to continue using the dual-tracking capabilities but register models in Azure Machine Learning, you can instruct MLflow to use Azure Machine Learning for model registries by configuring the MLflow Model Registry URI. This URI has the same format and value that the MLflow that tracks URI.
> The value of `azureml_mlflow_uri` was obtained in the same way as described in [Set MLflow tracking to only track in your Azure Machine Learning workspace](#tracking-exclusively-on-azure-machine-learning-workspace).
290
+
> The value of `azureml_mlflow_uri` was obtained in the same way as described in [Set MLflow tracking to only track in your Azure Machine Learning workspace](#track-exclusively-on-azure-machine-learning-workspace).
291
291
292
292
For a complete example of this scenario, see [Training models in Azure Databricks and deploying them on Azure Machine Learning](https://github.com/Azure/azureml-examples/blob/main/sdk/python/using-mlflow/deploy/track_with_databricks_deploy_aml.ipynb).
0 commit comments