Skip to content

Commit 8e23b2b

Browse files
Merge pull request #3136 from msakande/update-model-monitoring-article
PM update: authentication options and network limitations
2 parents 69d0677 + 1149728 commit 8e23b2b

File tree

1 file changed

+21
-1
lines changed

1 file changed

+21
-1
lines changed

articles/machine-learning/concept-model-monitoring.md

Lines changed: 21 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,7 @@ ms.service: azure-machine-learning
99
ms.subservice: mlops
1010
ms.reviewer: alehughes
1111
ms.topic: concept-article
12-
ms.date: 09/27/2024
12+
ms.date: 02/25/2025
1313
ms.custom: devplatv2, FY25Q1-Linter
1414
#Customer intent: As a data scientist, I want to understand Azure Machine Learning monitoring so I can keep my machine learning models fresh and performant.
1515
---
@@ -170,6 +170,26 @@ You can use events generated by Azure Machine Learning model monitoring runs to
170170

171171
For example, if the accuracy of your classification model in production dips below a certain threshold, you can use Event Grid to begin a retraining job that uses collected ground truth data. To learn how to integrate Azure Machine Learning with Event Grid, see [Monitor performance of models deployed to production](how-to-monitor-model-performance.md).
172172

173+
## Model monitoring authentication options
174+
175+
Azure Machine Learning model monitoring supports both credential-based and credential-less authentication to the datastore with the collected production inference data from your model. To configure credential-less authentication, follow these steps:
176+
177+
1. Create a User-Assigned Managed Identity (UAMI) and attach it to your Azure Machine Learning workspace.
178+
1. Grant the UAMI [proper permissions](how-to-identity-based-service-authentication.md#user-assigned-managed-identity) to access your datastore.
179+
1. Update the value of the workspace level property `systemDatastoresAuthMode` to `'identity'`.
180+
181+
Alternatively, you can add credentials to the datastore where your production inference data is stored.
182+
183+
To learn more about credential-less authentication with Azure Machine Learning, see [User-assigned managed identity](how-to-identity-based-service-authentication.md#user-assigned-managed-identity).
184+
185+
## Model monitoring limitations
186+
187+
Azure Machine Learning model monitoring has the following limitations:
188+
189+
- It doesn't support the `AllowOnlyApprovedOutbound` managed virtual network isolation setting. To learn more about managed virtual network isolation in Azure Machine Learning, see [Workspace Managed Virtual Network Isolation](how-to-managed-network.md).
190+
191+
- It depends on `Spark` to compute metrics over large-scale datasets. Because `MLTable` isn't well-supported by `Spark`, it's best to avoid using `MLTable` whenever possible with model monitoring jobs. Only basic `MLTable` files have guaranteed support. For complex or custom operations, consider using the `Spark` API directly in your code.
192+
173193
## Related content
174194

175195
- [Model data collection](concept-data-collection.md)

0 commit comments

Comments
 (0)