Skip to content

Commit 0cb7ba7

Browse files
committed
PM update: authentication options and network limitations
1 parent fce2499 commit 0cb7ba7

File tree

1 file changed

+20
-0
lines changed

1 file changed

+20
-0
lines changed

articles/machine-learning/concept-model-monitoring.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -170,6 +170,26 @@ You can use events generated by Azure Machine Learning model monitoring runs to
170170

171171
For example, if the accuracy of your classification model in production dips below a certain threshold, you can use Event Grid to begin a retraining job that uses collected ground truth data. To learn how to integrate Azure Machine Learning with Event Grid, see [Monitor performance of models deployed to production](how-to-monitor-model-performance.md).
172172

173+
## Model monitoring authentication options
174+
175+
Azure Machine Learning model monitoring supports both credential-based and credential-less authentication to the datastore with the collected production inference data from your model. To configure credential-less authentication, follow the steps below:
176+
177+
1) Create a User-Assigned Managed Identity (UAMI) and attach it to your Azure Machine Learning workspace
178+
2) Grant the UAMI [proper permissions](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-identity-based-service-authentication?view=azureml-api-2&tabs=cli#user-assigned-managed-identity) to access your datastore.
179+
3) Update the workspace level property `systemDatastoresAuthMode` to `'identity'`.
180+
181+
Or, you can simply add credentials to the datastore where your production inference data is being stored.
182+
183+
To learn more about credential-less authentication with Azure Machine Learning, see [here](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-identity-based-service-authentication?view=azureml-api-2&tabs=cli#user-assigned-managed-identity).
184+
185+
## Model monitoring networking limitations
186+
187+
Azure Machine Learning model monitoring does not support the `AllowOnlyApprovedOutbound` managed virtual network isolation setting. To learn more about managed virtual network isolation in Azure Machine Learning, see [here](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-managed-network?view=azureml-api-2&tabs=azure-cli).
188+
189+
## Model monitoring other limitations
190+
191+
Azure Machine Learning model monitoring has a dependency on `Spark` to compute metrics over large-scale datasets. `MLTable` is not well-supported by `Spark`, and thus it is recommended to avoid using `MLTable` whenever possible with model monitoring jobs. Only basic `MLTable` files are guaranteed to be supported. For complex or custom operations, we recommend using the `Spark` API directly in your code.
192+
173193
## Related content
174194

175195
- [Model data collection](concept-data-collection.md)

0 commit comments

Comments
 (0)