Skip to content

Commit d5eae0b

Browse files
committed
move limitations section in concept
1 parent dba9da4 commit d5eae0b

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

articles/machine-learning/concept-model-monitoring.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,10 @@ Model monitoring is the last step in the machine learning end-to-end lifecycle.
2424

2525
Unlike traditional software systems, the behavior of machine learning systems is governed not just by rules specified in code, but also by model behavior learned from data. Therefore, data distribution changes, training-serving skew, data quality issues, shifts in environments, or consumer behavior changes can all cause a model to become stale. When a model becomes stale, its performance can degrade to the point that it fails to add business value or starts to cause serious compliance issues in highly regulated environments.
2626

27+
## Limitations of model monitoring in Azure Machine Learning
28+
29+
Azure Machine Learning model monitoring supports only the use of credential-based authentication (e.g., SAS token) to access data contained in datastores. To learn more about datastores and authentication modes, see [Data administration](how-to-administrate-data-authentication.md).
30+
2731
## How model monitoring works in Azure Machine Learning
2832

2933
To implement monitoring, Azure Machine Learning acquires monitoring signals by performing statistical computations on streamed production inference data and reference data. The reference data can be historical training data, validation data, or ground truth data. On the other hand, the production inference data refers to the model's input and output data collected in production.
@@ -165,10 +169,6 @@ You can use events generated by Azure Machine Learning model monitoring runs to
165169

166170
When your model monitor detects drift, data quality issues, or model performance degradation, you can track these events with Event Grid and take action programmatically. For example, if the accuracy of your classification model in production dips below a certain threshold, you can use Event Grid to begin a retraining job that uses collected ground truth data. To learn how to integrate Azure Machine Learning with Event Grid, see [Perform continuous model monitoring in Azure Machine Learning](how-to-monitor-model-performance.md).
167171

168-
## Model monitoring limitations
169-
170-
Azure Machine Learning model monitoring only supports accessing data contained within datastores with credential-based authentication (e.g., SAS token). To learn more about datastores and authentication modes, see [Data administration](https://learn.microsoft.com/en-us/azure/machine-learning/how-to-administrate-data-authentication?view=azureml-api-2).
171-
172172
## Related content
173173

174174
- [Model data collection](concept-data-collection.md)

0 commit comments

Comments
 (0)