Skip to content

Commit 4f53694

Browse files
authored
Update how-to-monitor-online-endpoints.md
1 parent d7cfc78 commit 4f53694

File tree

1 file changed

+36
-21
lines changed

1 file changed

+36
-21
lines changed

articles/machine-learning/how-to-monitor-online-endpoints.md

Lines changed: 36 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -45,7 +45,7 @@ In this article you learn how to:
4545

4646
## Metrics
4747

48-
You can view metrics pages for online endpoints or deployments in the Azure portal. An easy way to access these metrics pages is through links available in the Azure Machine Learning studio user interfacespecifically in the **Details** tab of an endpoint's page. Following these links will take you to the exact metrics page in the Azure portal for the endpoint or deployment. Alternatively, you can also go into the Azure portal to search for the metrics page for the endpoint or deployment.
48+
You can view metrics pages for online endpoints or deployments in the Azure portal. An easy way to access these metrics pages is through links available in the Azure Machine Learning studio user interfacespecifically in the **Details** tab of an endpoint's page. Following these links will take you to the exact metrics page in the Azure portal for the endpoint or deployment. Alternatively, you can also go into the Azure portal to search for the metrics page for the endpoint or deployment.
4949

5050
To access the metrics pages through links available in the studio:
5151

@@ -87,11 +87,14 @@ Split on the following dimensions:
8787
- Status Code
8888
- Status Code Class
8989

90+
For instance, using splits you can compare request latency and/or requests per minute between different deployments under an endpoint.
91+
9092
**Bandwidth throttling**
9193

92-
Bandwidth will be throttled if the limits are exceeded for _managed_ online endpoints (see managed online endpoints section in [Manage and increase quotas for resources with Azure Machine Learning](how-to-manage-quotas.md#azure-machine-learning-managed-online-endpoints)). To determine if requests are throttled:
94+
Bandwidth will be throttled if the limits are exceeded for _managed_ online endpoints quota (see managed online endpoints section in [Manage and increase quotas for resources with Azure Machine Learning](how-to-manage-quotas.md#azure-machine-learning-managed-online-endpoints)). To determine if requests are throttled:
9395
- Monitor the "Network bytes" metric
9496
- The response trailers will have the fields: `ms-azureml-bandwidth-request-delay-ms` and `ms-azureml-bandwidth-response-delay-ms`. The values of the fields are the delays, in milliseconds, of the bandwidth throttling.
97+
For more information, see [Bandwidth limit issues](how-to-troubleshoot-online-endpoints.md#bandwidth-limit-issues).
9598

9699
#### Metrics at deployment scope
97100

@@ -106,25 +109,8 @@ Split on the following dimension:
106109

107110
- InstanceId
108111

109-
### Create a dashboard
110-
111-
You can create custom dashboards to visualize data from multiple sources in the Azure portal, including the metrics for your online endpoint. For more information, see [Create custom KPI dashboards using Application Insights](../azure-monitor/app/tutorial-app-dashboards.md#add-custom-metric-chart).
112-
113-
### Create an alert
114-
115-
You can also create custom alerts to notify you of important status updates to your online endpoint:
116-
117-
1. At the top right of the metrics page, select **New alert rule**.
112+
For instance, you can compare CPU and/or memory utilization between difference instances for an online deployment.
118113

119-
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" alt-text="Monitoring online endpoints: screenshot showing 'New alert rule' button surrounded by a red box":::
120-
121-
1. Select a condition name to specify when your alert should be triggered.
122-
123-
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-configure-signal-logic.png" alt-text="Monitoring online endpoints: screenshot showing 'Configure signal logic' button surrounded by a red box":::
124-
125-
1. Select **Add action groups** > **Create action groups** to specify what should happen when your alert is triggered.
126-
127-
1. Choose **Create alert rule** to finish creating your alert.
128114

129115
## Logs
130116

@@ -252,7 +238,36 @@ The following tables provide details on the data stored in each log:
252238
| Message | The content of the event.
253239

254240

255-
## Using application insights
241+
## Using Application Insights
242+
243+
When your online deployment uses curated docker image, it includes the integration with Application Insights. To activate log collection using Application Insights, you can simply enable it when you create an online deployment. Built-in metrics and logs are sent to Application insights, and you can use its built-in features such as Live metrics, Transaction search, Failures and Performance.
244+
245+
246+
## Create dashboards and alerts
247+
248+
Azure Monitor allows creating dashboards and alerts based on metrics.
249+
250+
### Create dashboards and visualize queries
251+
252+
You can create custom dashboards and visualize metrics from multiple sources in the Azure portal, including the metrics for your online endpoint. For more information on creating dashboards and visualizing queries, see [Dashboards using log data](../azure-monitor/visualize/tutorial-logs-dashboards.md) and [Dashboards using application data](../azure-monitor/app/tutorial-app-dashboards.md).
253+
254+
### Create alerts
255+
256+
You can also create custom alerts to notify you of important status updates to your online endpoint:
257+
258+
1. At the top right of the metrics page, select **New alert rule**.
259+
260+
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" alt-text="Monitoring online endpoints: screenshot showing 'New alert rule' button surrounded by a red box":::
261+
262+
1. Select a condition name to specify when your alert should be triggered.
263+
264+
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-configure-signal-logic.png" alt-text="Monitoring online endpoints: screenshot showing 'Configure signal logic' button surrounded by a red box":::
265+
266+
1. Select **Add action groups** > **Create action groups** to specify what should happen when your alert is triggered.
267+
268+
1. Choose **Create alert rule** to finish creating your alert.
269+
270+
For more information, see [Create Azure Monitor alert rules](../azure-monitor/alerts/alerts-create-new-alert-rule.md).
256271

257272

258273
## Next steps

0 commit comments

Comments
 (0)