Skip to content

Commit 523a0d0

Browse files
committed
Update screenshots and text
1 parent c62c7a9 commit 523a0d0

8 files changed

+54
-30
lines changed

articles/machine-learning/how-to-monitor-online-endpoints.md

Lines changed: 54 additions & 30 deletions
Original file line numberDiff line numberDiff line change
@@ -44,22 +44,35 @@ You can view metrics pages for online endpoints or deployments in the Azure port
4444

4545
To access the metrics pages through links available in the studio:
4646

47-
1. Go to the [Azure Machine Learning studio](https://ml.azure.com).
48-
1. In the left navigation bar, select the **Endpoints** page.
49-
1. Select an endpoint by clicking its name.
50-
1. Select **View metrics** in the **Attributes** section of the endpoint to open up the endpoint's metrics page in the Azure portal.
51-
1. Select **View metrics** in the section for each available deployment to open up the deployment's metrics page in the Azure portal.
47+
1. In [Azure Machine Learning studio](https://ml.azure.com), go to your workspace.
5248

53-
:::image type="content" source="media/how-to-monitor-online-endpoints/online-endpoints-access-metrics-from-studio.png" alt-text="A screenshot showing how to access the metrics of an endpoint and deployment from the studio UI." lightbox="media/how-to-monitor-online-endpoints/online-endpoints-access-metrics-from-studio.png":::
49+
1. Under **Assets**, select **Endpoints**.
50+
51+
1. Select the name of an endpoint.
52+
53+
1. Under **Endpoint attributes**, select **View metrics**.
54+
55+
:::image type="content" source="media/how-to-monitor-online-endpoints/online-endpoints-access-metrics-studio.png" alt-text="A screenshot showing how to access the metrics of an endpoint and deployment from the studio UI." lightbox="media/how-to-monitor-online-endpoints/online-endpoints-access-metrics-studio.png":::
56+
57+
The endpoint's metrics page opens in the Azure portal.
58+
59+
1. In Azure Machine Learning studio, go to the section for a deployment, and then select **View metrics**.
60+
61+
:::image type="content" source="media/how-to-monitor-online-endpoints/deployment-metrics-studio.png" alt-text="A screenshot showing how to access the metrics of an endpoint and deployment from the studio UI." lightbox="media/how-to-monitor-online-endpoints/deployment-metrics-studio.png":::
62+
63+
The deployment's metrics page opens in the Azure portal.
5464

5565
To access metrics directly from the Azure portal:
5666

57-
1. Sign in to the [Azure portal](https://portal.azure.com).
58-
1. Navigate to the online endpoint or deployment resource.
67+
1. Go to the [Azure portal](https://portal.azure.com).
68+
69+
1. Go to the online endpoint or deployment resource.
70+
71+
Online endpoints and deployments are Azure Resource Manager resources. You can find them by going to their resource group and then looking for the resource types **Machine Learning online endpoint** and **Machine Learning online deployment**.
5972

60-
Online endpoints and deployments are Azure Resource Manager (ARM) resources that can be found by going to their owning resource group. Look for the resource types **Machine Learning online endpoint** and **Machine Learning online deployment**.
73+
1. Under **Monitoring**, select **Metrics**.
6174

62-
1. In the left-hand column, select **Metrics**.
75+
:::image type="content" source="media/how-to-monitor-online-endpoints/endpoint-metrics-azure-portal.png" alt-text="A screenshot showing how to access the metrics of an endpoint and deployment from the studio UI." lightbox="media/how-to-monitor-online-endpoints/endpoint-metrics-azure-portal.png":::
6376

6477
### Available metrics
6578

@@ -83,7 +96,7 @@ For more information, see [Bandwidth limit issues](how-to-troubleshoot-online-en
8396

8497
### Create dashboards and alerts
8598

86-
Azure Monitor allows you to create dashboards and alerts, based on metrics.
99+
Azure Monitor allows you to create dashboards and alerts that are based on metrics.
87100

88101
#### Create dashboards and visualize queries
89102

@@ -93,31 +106,31 @@ You can create custom dashboards and visualize metrics from multiple sources in
93106

94107
You can also create custom alerts to notify you of important status updates to your online endpoint:
95108

96-
1. At the top right of the metrics page, select **New alert rule**.
109+
1. In the Azure portal, go to a metrics page, and then select **New alert rule**.
97110

98-
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" alt-text="Screenshot showing 'New alert rule' button surrounded by a red box." lightbox="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" :::
111+
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" alt-text="Screenshot showing 'New alert rule' button surrounded by a red box." lightbox="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" :::
99112

100-
1. Select a condition name to specify when your alert should be triggered.
113+
1. In the Select a signal window, select the signal that you want to create an alert for, and then select **Apply**.
101114

102-
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-configure-signal-logic.png" alt-text="Screenshot showing 'Configure signal logic' button surrounded by a red box." lightbox="./media/how-to-monitor-online-endpoints/online-endpoints-configure-signal-logic.png" :::
115+
1. In the Create an alert rule page, enter a threshold, and edit any other settings that you want to adjust. For more information about alert rule settings, see [Configure the alert rule conditions](/azure/azure-monitor/alerts/alerts-create-metric-alert-rule#configure-the-alert-rule-conditions). Then select **Next: Actions**.
103116

104-
1. Select **Add action groups** > **Create action groups** to specify what should happen when your alert is triggered.
117+
:::image type="content" source="./media/how-to-monitor-online-endpoints/configure-alert-rule.png" alt-text="Screenshot showing 'New alert rule' button surrounded by a red box." lightbox="./media/how-to-monitor-online-endpoints/configure-alert-rule.png" :::
105118

106-
1. Choose **Create alert rule** to finish creating your alert.
119+
1. In the Select action groups window, create or select an action group to specify what happens when your alert is triggered. For more information, see [Configure the alert rule details](/azure/azure-monitor/alerts/alerts-create-metric-alert-rule#configure-the-alert-rule-details).
107120

108-
For more information, see [Create Azure Monitor alert rules](/azure/azure-monitor/alerts/alerts-create-new-alert-rule).
121+
1. Choose **Review + Create** to finish creating your alert.
109122

110-
### Enable autoscale based on metrics
123+
### Scale automatically based on metrics
111124

112-
You can enable autoscale of deployments using metrics using UI or code. When you use code (either CLI or SDK), you can use Metrics IDs listed in the table of [available metrics](#available-metrics) in condition for triggering autoscaling. For more information, see [Autoscaling online endpoints](how-to-autoscale-endpoints.md).
125+
You can configure deployments to scale automatically based on metrics. To turn on the autoscale feature, you can use the UI or code. The options for code are the Azure Machine Learning CLI and the Azure Machine Learning SDK for Python. When you use code, you provide the IDs of metrics in the conditions for triggering automatic scaling. For those IDs, you can use the metrics that the table lists in the [Available metrics](#available-metrics) section. For more information, see [Autoscaling online endpoints](how-to-autoscale-endpoints.md).
113126

114127
## Logs
115128

116-
There are three logs that can be enabled for online endpoints:
129+
There are three logs that you can turn on for online endpoints:
117130

118-
* **AmlOnlineEndpointTrafficLog**: You could choose to enable traffic logs if you want to check the information of your request. Below are some cases:
131+
* **AmlOnlineEndpointTrafficLog**: This traffic log provides a way for you to check the information of a request to the endpoint. You can use this log in the following cases:
119132

120-
* If the response isn't 200, check the value of the column "ResponseCodeReason" to see what happened. Also check the reason in the "HTTPS status codes" section of the [Troubleshoot online endpoints](how-to-troubleshoot-online-endpoints.md#http-status-codes) article.
133+
* If the request response isn't 200, check the value of the `ResponseCodeReason` column to see the reason. Also check the reason in [HTTPS status codes](how-to-troubleshoot-online-endpoints.md#http-status-codes), in the article about troubleshooting online endpoints.
121134

122135
* You could check the response code and response reason of your model from the column "ModelStatusCode" and "ModelStatusReason".
123136

@@ -153,22 +166,33 @@ There are three logs that can be enabled for online endpoints:
153166
| Killing | Stopping container inference-server
154167
| Killing | Stopping container model-mount
155168

156-
### How to enable/disable logs
169+
### Turn logs on or off
157170

158171
> [!IMPORTANT]
159172
> Logging uses Azure Log Analytics. If you do not currently have a Log Analytics workspace, you can create one using the steps in [Create a Log Analytics workspace in the Azure portal](/azure/azure-monitor/logs/quick-create-workspace#create-a-workspace).
160173
161174
1. In the [Azure portal](https://portal.azure.com), go to the resource group that contains your endpoint and then select the endpoint.
162-
1. From the **Monitoring** section on the left of the page, select **Diagnostic settings** and then **Add settings**.
163-
1. Select the log categories to enable, select **Send to Log Analytics workspace**, and then select the Log Analytics workspace to use. Finally, enter a **Diagnostic setting name** and select **Save**.
164175

165-
:::image type="content" source="./media/how-to-monitor-online-endpoints/diagnostic-settings.png" alt-text="Screenshot of the diagnostic settings dialog.":::
176+
1. Under **Monitoring**, select **Diagnostic settings**, and then select **Add diagnostic setting**.
177+
178+
1. In the Diagnostic setting window, enter the following information:
179+
- Next to **Diagnostic setting name**, enter a name for your setting.
180+
- Select the log categories that you want to turn on.
181+
- Select **Send to Log Analytics workspace**, and then select the subscription and the Log Analytics workspace to use.
182+
183+
:::image type="content" source="./media/how-to-monitor-online-endpoints/diagnostic-settings.png" alt-text="Screenshot of the diagnostic settings dialog.":::
184+
185+
1. Select **Save**.
166186

167187
> [!IMPORTANT]
168-
> It may take up to an hour for the connection to the Log Analytics workspace to be enabled. Wait an hour before continuing with the next steps.
169-
170-
1. Submit scoring requests to the endpoint. This activity should create entries in the logs.
188+
> It may take up to an hour for the connection to the Log Analytics workspace to be enabled. Wait an hour before continuing with the steps in the next section.
189+
190+
### View logs
191+
192+
1. Submit scoring requests to the endpoint to create entries in the logs.
193+
171194
1. From either the online endpoint properties or the Log Analytics workspace, select **Logs** from the left of the screen.
195+
172196
1. Close the **Queries** dialog that automatically opens, and then double-click the **AmlOnlineEndpointConsoleLog**. If you don't see it, use the **Search** field.
173197

174198
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-log-queries.png" alt-text="Screenshot showing the log queries.":::
57.9 KB
Loading
41.4 KB
Loading
60.8 KB
Loading
148 KB
Loading
24.2 KB
Loading

0 commit comments

Comments
 (0)