You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
#Customer intent: As a data scientist, I want to understand Azure Machine Learning monitoring so I can keep my machine learning models fresh and performant.
15
15
---
@@ -170,6 +170,26 @@ You can use events generated by Azure Machine Learning model monitoring runs to
170
170
171
171
For example, if the accuracy of your classification model in production dips below a certain threshold, you can use Event Grid to begin a retraining job that uses collected ground truth data. To learn how to integrate Azure Machine Learning with Event Grid, see [Monitor performance of models deployed to production](how-to-monitor-model-performance.md).
172
172
173
+
## Model monitoring authentication options
174
+
175
+
Azure Machine Learning model monitoring supports both credential-based and credential-less authentication to the datastore with the collected production inference data from your model. To configure credential-less authentication, follow these steps:
176
+
177
+
1. Create a User-Assigned Managed Identity (UAMI) and attach it to your Azure Machine Learning workspace.
178
+
1. Grant the UAMI [proper permissions](how-to-identity-based-service-authentication.md#user-assigned-managed-identity) to access your datastore.
179
+
1. Update the value of the workspace level property `systemDatastoresAuthMode` to `'identity'`.
180
+
181
+
Alternatively, you can add credentials to the datastore where your production inference data is stored.
182
+
183
+
To learn more about credential-less authentication with Azure Machine Learning, see [User-assigned managed identity](how-to-identity-based-service-authentication.md#user-assigned-managed-identity).
184
+
185
+
## Model monitoring limitations
186
+
187
+
Azure Machine Learning model monitoring has the following limitations:
188
+
189
+
- It doesn't support the `AllowOnlyApprovedOutbound` managed virtual network isolation setting. To learn more about managed virtual network isolation in Azure Machine Learning, see [Workspace Managed Virtual Network Isolation](how-to-managed-network.md).
190
+
191
+
- It depends on `Spark` to compute metrics over large-scale datasets. Because `MLTable` isn't well-supported by `Spark`, it's best to avoid using `MLTable` whenever possible with model monitoring jobs. Only basic `MLTable` files have guaranteed support. For complex or custom operations, consider using the `Spark` API directly in your code.
192
+
173
193
## Related content
174
194
175
195
-[Model data collection](concept-data-collection.md)
0 commit comments