Skip to content

Commit 0b23009

Browse files
authored
Update how-to-monitor-datasets.md
1 parent d9f5d3e commit 0b23009

File tree

1 file changed

+15
-17
lines changed

1 file changed

+15
-17
lines changed

articles/machine-learning/v1/how-to-monitor-datasets.md

Lines changed: 15 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -16,11 +16,9 @@ ms.custom: UpdateFrequency5, data4ml, sdkv1
1616

1717
# Data drift (preview) will be retired, and replaced by Model Monitor
1818

19-
Data drift(preview) will be retired at 09/01/2025, and you can start to use [Model Monitor](https://learn.microsoft.com/azure/machine-learning/how-to-monitor-model-performance?view=azureml-api-2&tabs=azure-cli) for your data drift tasks.
19+
Data drift(preview) will be retired at 09/01/2025, and you can start to use [Model Monitor](../how-to-monitor-model-performance.md) for your data drift tasks.
2020
Please check the content below to understand the replacement, feature gaps and manual change steps.
2121

22-
# Detect data drift (preview) on datasets
23-
2422
[!INCLUDE [sdk v1](../includes/machine-learning-sdk-v1.md)]
2523

2624
Learn how to monitor data drift and set alerts when drift is high.
@@ -59,29 +57,29 @@ When you migrate to Model Monitor, please check the prerequisites as following:
5957

6058
# [Azure CLI](#tab/azure-cli)
6159

62-
[!INCLUDE [basic prereqs cli](./includes/machine-learning-cli-prereqs.md)]
60+
[!INCLUDE [basic prereqs cli](../includes/machine-learning-cli-prereqs.md)]
6361

6462
# [Python SDK](#tab/python)
6563

66-
[!INCLUDE [basic prereqs sdk](./includes/machine-learning-sdk-v2-prereqs.md)]
64+
[!INCLUDE [basic prereqs sdk](../includes/machine-learning-sdk-v2-prereqs.md)]
6765

6866
# [Studio](#tab/azure-studio)
6967

7068
Before following the steps in this article, make sure you have the following prerequisites:
7169

7270
* An Azure subscription. If you don't have an Azure subscription, create a free account before you begin. Try the [free or paid version of Azure Machine Learning](https://azure.microsoft.com/free/).
7371

74-
* An Azure Machine Learning workspace and a compute instance. If you don't have these resources, use the steps in the [Quickstart: Create workspace resources](./quickstart-create-resources.md) article to create them.
72+
* An Azure Machine Learning workspace and a compute instance. If you don't have these resources, use the steps in the [Quickstart: Create workspace resources](../quickstart-create-resources.md) article to create them.
7573

7674
---
7775

78-
* Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure Machine Learning. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure Machine Learning workspace, or a custom role allowing `Microsoft.MachineLearningServices/workspaces/onlineEndpoints/*`. For more information, see [Manage access to an Azure Machine Learning workspace](./how-to-assign-roles.md).
76+
* Azure role-based access controls (Azure RBAC) are used to grant access to operations in Azure Machine Learning. To perform the steps in this article, your user account must be assigned the __owner__ or __contributor__ role for the Azure Machine Learning workspace, or a custom role allowing `Microsoft.MachineLearningServices/workspaces/onlineEndpoints/*`. For more information, see [Manage access to an Azure Machine Learning workspace](../how-to-assign-roles.md).
7977

8078
* For monitoring a model that is deployed to an Azure Machine Learning online endpoint (managed online endpoint or Kubernetes online endpoint), be sure to:
8179

82-
* Have a model already deployed to an Azure Machine Learning online endpoint. Both managed online endpoint and Kubernetes online endpoint are supported. If you don't have a model deployed to an Azure Machine Learning online endpoint, see [Deploy and score a machine learning model by using an online endpoint](./how-to-deploy-online-endpoints.md).
80+
* Have a model already deployed to an Azure Machine Learning online endpoint. Both managed online endpoint and Kubernetes online endpoint are supported. If you don't have a model deployed to an Azure Machine Learning online endpoint, see [Deploy and score a machine learning model by using an online endpoint](../how-to-deploy-online-endpoints.md).
8381

84-
* Enable data collection for your model deployment. You can enable data collection during the deployment step for Azure Machine Learning online endpoints. For more information, see [Collect production data from models deployed to a real-time endpoint](./how-to-collect-production-data.md).
82+
* Enable data collection for your model deployment. You can enable data collection during the deployment step for Azure Machine Learning online endpoints. For more information, see [Collect production data from models deployed to a real-time endpoint](../how-to-collect-production-data.md).
8583

8684
* For monitoring a model that is deployed to an Azure Machine Learning batch endpoint or deployed outside of Azure Machine Learning, be sure to:
8785

@@ -148,7 +146,7 @@ You monitor [Azure Machine Learning datasets](how-to-create-register-datasets.md
148146
The monitor compares the baseline and target datasets.
149147

150148
#### Migrate to Model Monitor
151-
In Model Monitor, you can find corresponding concepts as following, and you can find more details in this article [Set up model monitoring by bringing in your production data to Azure Machine Learning](https://learn.microsoft.com/azure/machine-learning/how-to-monitor-model-performance?view=azureml-api-2&tabs=azure-cli#set-up-out-of-box-model-monitoring):
149+
In Model Monitor, you can find corresponding concepts as following, and you can find more details in this article [Set up model monitoring by bringing in your production data to Azure Machine Learning](../how-to-monitor-model-performance.md#set-up-out-of-box-model-monitoring):
152150
* Reference dataset: similar to your baseline dataset for data drift detection, it is set as the recent past production inference dataset.
153151
* Production inference data: similar to your target dataset in data drift detection, the production inference data can be collected automatically from models deployed in production. It can also be inference data you store.
154152

@@ -318,15 +316,15 @@ After completion of the wizard, the resulting dataset monitor will appear in the
318316
---
319317

320318
### Migrate to Model Monitor
321-
When you migrate to Model Monitor, if you have deployed your model to production in an Azure Machine Learning online endpoint and enabled [data collection](https://learn.microsoft.com/azure/machine-learning/how-to-collect-production-data?view=azureml-api-2&tabs=azure-cli) at deployment time, Azure Machine Learning collects production inference data, and automatically stores it in Microsoft Azure Blob Storage. You can then use Azure Machine Learning model monitoring to continuously monitor this production inference data, and you can directly choose the model to create target dataset (production inference data in Model Monitor).
319+
When you migrate to Model Monitor, if you have deployed your model to production in an Azure Machine Learning online endpoint and enabled [data collection](../how-to-collect-production-data.md) at deployment time, Azure Machine Learning collects production inference data, and automatically stores it in Microsoft Azure Blob Storage. You can then use Azure Machine Learning model monitoring to continuously monitor this production inference data, and you can directly choose the model to create target dataset (production inference data in Model Monitor).
322320

323-
When you migrate to Model Monitor, if you didn't deploy your model to production in an Azure Machine Learning online endpoint, or you don't want to use [data collection](https://learn.microsoft.com/azure/machine-learning/how-to-collect-production-data?view=azureml-api-2&tabs=azure-cli), you can also [set up model monitoring with custom signals and metrics](https://learn.microsoft.com/en-us/machine-learning/how-to-monitor-model-performance?view=azureml-api-2&tabs=azure-studio#set-up-model-monitoring-with-custom-signals-and-metrics).
321+
When you migrate to Model Monitor, if you didn't deploy your model to production in an Azure Machine Learning online endpoint, or you don't want to use [data collection](../how-to-collect-production-data.md), you can also [set up model monitoring with custom signals and metrics](../how-to-monitor-model-performance.md#set-up-model-monitoring-with-custom-signals-and-metrics).
324322

325323
Following sections contain more details on how to migrate to Model Monitor.
326324

327325
### If you have deployed your model to production in an Azure Machine Learning online endpoint and enabled data collection
328326

329-
If you have deployed your model to production in an Azure Machine Learning online endpoint and enabled [data collection](https://learn.microsoft.com/azure/machine-learning/how-to-collect-production-data?view=azureml-api-2&tabs=azure-cli) at deployment time.
327+
If you have deployed your model to production in an Azure Machine Learning online endpoint and enabled [data collection](../how-to-collect-production-data.md) at deployment time.
330328

331329
# [Azure CLI](#tab/azure-cli)
332330

@@ -415,7 +413,7 @@ created_monitor = poller.result()
415413
1. Select **Monitoring** from the **Manage** section
416414
1. Select **Add**.
417415

418-
:::image type="content" source="./media/how-to-monitor-models/add-model-monitoring.png" alt-text="Screenshot showing how to add model monitoring." lightbox="./media/how-to-monitor-models/add-model-monitoring.png":::
416+
:::image type="content" source="../media/how-to-monitor-models/add-model-monitoring.png" alt-text="Screenshot showing how to add model monitoring." lightbox="../media/how-to-monitor-models/add-model-monitoring.png":::
419417

420418
1. On the **Basic settings** page, use **(Optional) Select model** to choose the model to monitor.
421419
1. The **(Optional) Select deployment with data collection enabled** dropdown list should be automatically populated if the model is deployed to an Azure Machine Learning online endpoint. Select the deployment from the dropdown list.
@@ -426,7 +424,7 @@ created_monitor = poller.result()
426424
1. Select **Recurrence** or **Cron expression** scheduling.
427425
1. For **Recurrence** scheduling, specify the repeat frequency, day, and time. For **Cron expression** scheduling, enter a cron expression for monitoring run.
428426

429-
:::image type="content" source="./media/how-to-monitor-models/model-monitoring-basic-setup.png" alt-text="Screenshot of basic settings page for model monitoring." lightbox="./media/how-to-monitor-models/model-monitoring-basic-setup.png":::
427+
:::image type="content" source="../media/how-to-monitor-models/model-monitoring-basic-setup.png" alt-text="Screenshot of basic settings page for model monitoring." lightbox="../media/how-to-monitor-models/model-monitoring-basic-setup.png":::
430428

431429
1. Select **Next** to go to the **Advanced settings** section.
432430
1. Select **Next** on the **Configure data asset** page to keep the default datasets.
@@ -436,15 +434,15 @@ created_monitor = poller.result()
436434

437435

438436
### If you didn't deploy your model to production in an Azure Machine Learning online endpoint or you don't want to use data collection
439-
When you migrate to Model Monitor, if you didn't deploy your model to production in an Azure Machine Learning online endpoint, or you don't want to use [data collection](https://learn.microsoft.com/azure/machine-learning/how-to-collect-production-data?view=azureml-api-2&tabs=azure-cli), you can also [set up model monitoring with custom signals and metrics](https://learn.microsoft.com/en-us/machine-learning/how-to-monitor-model-performance?view=azureml-api-2&tabs=azure-studio#set-up-model-monitoring-with-custom-signals-and-metrics).
437+
When you migrate to Model Monitor, if you didn't deploy your model to production in an Azure Machine Learning online endpoint, or you don't want to use [data collection](../how-to-collect-production-data.md), you can also [set up model monitoring with custom signals and metrics](../how-to-monitor-model-performance.md#set-up-model-monitoring-with-custom-signals-and-metrics).
440438

441439
You can also set up model monitoring for models deployed to Azure Machine Learning batch endpoints or deployed outside of Azure Machine Learning. If you don't have a deployment, but you have production data, you can use the data to perform continuous model monitoring. To monitor these models, you must be able to:
442440

443441
* Collect production inference data from models deployed in production.
444442
* Register the production inference data as an Azure Machine Learning data asset, and ensure continuous updates of the data.
445443
* Provide a custom data preprocessing component and register it as an Azure Machine Learning component.
446444

447-
You must provide a custom data preprocessing component if your data isn't collected with the [data collector](./how-to-collect-production-data.md). Without this custom data preprocessing component, the Azure Machine Learning model monitoring system won't know how to process your data into tabular form with support for time windowing.
445+
You must provide a custom data preprocessing component if your data isn't collected with the [data collector](../how-to-collect-production-data.md). Without this custom data preprocessing component, the Azure Machine Learning model monitoring system won't know how to process your data into tabular form with support for time windowing.
448446

449447
Your custom preprocessing component must have these input and output signatures:
450448

0 commit comments

Comments
 (0)