You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-monitor-online-endpoints.md
+36-21Lines changed: 36 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -45,7 +45,7 @@ In this article you learn how to:
45
45
46
46
## Metrics
47
47
48
-
You can view metrics pages for online endpoints or deployments in the Azure portal. An easy way to access these metrics pages is through links available in the Azure Machine Learning studio user interface—specifically in the **Details** tab of an endpoint's page. Following these links will take you to the exact metrics page in the Azure portal for the endpoint or deployment. Alternatively, you can also go into the Azure portal to search for the metrics page for the endpoint or deployment.
48
+
You can view metrics pages for online endpoints or deployments in the Azure portal. An easy way to access these metrics pages is through links available in the Azure Machine Learning studio user interface — specifically in the **Details** tab of an endpoint's page. Following these links will take you to the exact metrics page in the Azure portal for the endpoint or deployment. Alternatively, you can also go into the Azure portal to search for the metrics page for the endpoint or deployment.
49
49
50
50
To access the metrics pages through links available in the studio:
51
51
@@ -87,11 +87,14 @@ Split on the following dimensions:
87
87
- Status Code
88
88
- Status Code Class
89
89
90
+
For instance, using splits you can compare request latency and/or requests per minute between different deployments under an endpoint.
91
+
90
92
**Bandwidth throttling**
91
93
92
-
Bandwidth will be throttled if the limits are exceeded for _managed_ online endpoints (see managed online endpoints section in [Manage and increase quotas for resources with Azure Machine Learning](how-to-manage-quotas.md#azure-machine-learning-managed-online-endpoints)). To determine if requests are throttled:
94
+
Bandwidth will be throttled if the limits are exceeded for _managed_ online endpoints quota (see managed online endpoints section in [Manage and increase quotas for resources with Azure Machine Learning](how-to-manage-quotas.md#azure-machine-learning-managed-online-endpoints)). To determine if requests are throttled:
93
95
- Monitor the "Network bytes" metric
94
96
- The response trailers will have the fields: `ms-azureml-bandwidth-request-delay-ms` and `ms-azureml-bandwidth-response-delay-ms`. The values of the fields are the delays, in milliseconds, of the bandwidth throttling.
97
+
For more information, see [Bandwidth limit issues](how-to-troubleshoot-online-endpoints.md#bandwidth-limit-issues).
95
98
96
99
#### Metrics at deployment scope
97
100
@@ -106,25 +109,8 @@ Split on the following dimension:
106
109
107
110
- InstanceId
108
111
109
-
### Create a dashboard
110
-
111
-
You can create custom dashboards to visualize data from multiple sources in the Azure portal, including the metrics for your online endpoint. For more information, see [Create custom KPI dashboards using Application Insights](../azure-monitor/app/tutorial-app-dashboards.md#add-custom-metric-chart).
112
-
113
-
### Create an alert
114
-
115
-
You can also create custom alerts to notify you of important status updates to your online endpoint:
116
-
117
-
1. At the top right of the metrics page, select **New alert rule**.
112
+
For instance, you can compare CPU and/or memory utilization between difference instances for an online deployment.
118
113
119
-
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" alt-text="Monitoring online endpoints: screenshot showing 'New alert rule' button surrounded by a red box":::
120
-
121
-
1. Select a condition name to specify when your alert should be triggered.
122
-
123
-
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-configure-signal-logic.png" alt-text="Monitoring online endpoints: screenshot showing 'Configure signal logic' button surrounded by a red box":::
124
-
125
-
1. Select **Add action groups** > **Create action groups** to specify what should happen when your alert is triggered.
126
-
127
-
1. Choose **Create alert rule** to finish creating your alert.
128
114
129
115
## Logs
130
116
@@ -252,7 +238,36 @@ The following tables provide details on the data stored in each log:
252
238
| Message | The content of the event.
253
239
254
240
255
-
## Using application insights
241
+
## Using Application Insights
242
+
243
+
When your online deployment uses curated docker image, it includes the integration with Application Insights. To activate log collection using Application Insights, you can simply enable it when you create an online deployment. Built-in metrics and logs are sent to Application insights, and you can use its built-in features such as Live metrics, Transaction search, Failures and Performance.
244
+
245
+
246
+
## Create dashboards and alerts
247
+
248
+
Azure Monitor allows creating dashboards and alerts based on metrics.
249
+
250
+
### Create dashboards and visualize queries
251
+
252
+
You can create custom dashboards and visualize metrics from multiple sources in the Azure portal, including the metrics for your online endpoint. For more information on creating dashboards and visualizing queries, see [Dashboards using log data](../azure-monitor/visualize/tutorial-logs-dashboards.md) and [Dashboards using application data](../azure-monitor/app/tutorial-app-dashboards.md).
253
+
254
+
### Create alerts
255
+
256
+
You can also create custom alerts to notify you of important status updates to your online endpoint:
257
+
258
+
1. At the top right of the metrics page, select **New alert rule**.
259
+
260
+
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" alt-text="Monitoring online endpoints: screenshot showing 'New alert rule' button surrounded by a red box":::
261
+
262
+
1. Select a condition name to specify when your alert should be triggered.
263
+
264
+
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-configure-signal-logic.png" alt-text="Monitoring online endpoints: screenshot showing 'Configure signal logic' button surrounded by a red box":::
265
+
266
+
1. Select **Add action groups** > **Create action groups** to specify what should happen when your alert is triggered.
267
+
268
+
1. Choose **Create alert rule** to finish creating your alert.
269
+
270
+
For more information, see [Create Azure Monitor alert rules](../azure-monitor/alerts/alerts-create-new-alert-rule.md).
0 commit comments