You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-monitor-online-endpoints.md
+54-30Lines changed: 54 additions & 30 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -44,22 +44,35 @@ You can view metrics pages for online endpoints or deployments in the Azure port
44
44
45
45
To access the metrics pages through links available in the studio:
46
46
47
-
1. Go to the [Azure Machine Learning studio](https://ml.azure.com).
48
-
1. In the left navigation bar, select the **Endpoints** page.
49
-
1. Select an endpoint by clicking its name.
50
-
1. Select **View metrics** in the **Attributes** section of the endpoint to open up the endpoint's metrics page in the Azure portal.
51
-
1. Select **View metrics** in the section for each available deployment to open up the deployment's metrics page in the Azure portal.
47
+
1. In [Azure Machine Learning studio](https://ml.azure.com), go to your workspace.
52
48
53
-
:::image type="content" source="media/how-to-monitor-online-endpoints/online-endpoints-access-metrics-from-studio.png" alt-text="A screenshot showing how to access the metrics of an endpoint and deployment from the studio UI." lightbox="media/how-to-monitor-online-endpoints/online-endpoints-access-metrics-from-studio.png":::
49
+
1. Under **Assets**, select **Endpoints**.
50
+
51
+
1. Select the name of an endpoint.
52
+
53
+
1. Under **Endpoint attributes**, select **View metrics**.
54
+
55
+
:::image type="content" source="media/how-to-monitor-online-endpoints/online-endpoints-access-metrics-studio.png" alt-text="A screenshot showing how to access the metrics of an endpoint and deployment from the studio UI." lightbox="media/how-to-monitor-online-endpoints/online-endpoints-access-metrics-studio.png":::
56
+
57
+
The endpoint's metrics page opens in the Azure portal.
58
+
59
+
1. In Azure Machine Learning studio, go to the section for a deployment, and then select **View metrics**.
60
+
61
+
:::image type="content" source="media/how-to-monitor-online-endpoints/deployment-metrics-studio.png" alt-text="A screenshot showing how to access the metrics of an endpoint and deployment from the studio UI." lightbox="media/how-to-monitor-online-endpoints/deployment-metrics-studio.png":::
62
+
63
+
The deployment's metrics page opens in the Azure portal.
54
64
55
65
To access metrics directly from the Azure portal:
56
66
57
-
1. Sign in to the [Azure portal](https://portal.azure.com).
58
-
1. Navigate to the online endpoint or deployment resource.
67
+
1. Go to the [Azure portal](https://portal.azure.com).
68
+
69
+
1. Go to the online endpoint or deployment resource.
70
+
71
+
Online endpoints and deployments are Azure Resource Manager resources. You can find them by going to their resource group and then looking for the resource types **Machine Learning online endpoint** and **Machine Learning online deployment**.
59
72
60
-
Online endpoints and deployments are Azure Resource Manager (ARM) resources that can be found by going to their owning resource group. Look for the resource types **Machine Learning online endpoint** and**Machine Learning online deployment**.
73
+
1. Under **Monitoring**, select**Metrics**.
61
74
62
-
1. In the left-hand column, select **Metrics**.
75
+
:::image type="content" source="media/how-to-monitor-online-endpoints/endpoint-metrics-azure-portal.png" alt-text="A screenshot showing how to access the metrics of an endpoint and deployment from the studio UI." lightbox="media/how-to-monitor-online-endpoints/endpoint-metrics-azure-portal.png":::
63
76
64
77
### Available metrics
65
78
@@ -83,7 +96,7 @@ For more information, see [Bandwidth limit issues](how-to-troubleshoot-online-en
83
96
84
97
### Create dashboards and alerts
85
98
86
-
Azure Monitor allows you to create dashboards and alerts, based on metrics.
99
+
Azure Monitor allows you to create dashboards and alerts that are based on metrics.
87
100
88
101
#### Create dashboards and visualize queries
89
102
@@ -93,31 +106,31 @@ You can create custom dashboards and visualize metrics from multiple sources in
93
106
94
107
You can also create custom alerts to notify you of important status updates to your online endpoint:
95
108
96
-
1.At the top right of the metrics page, select **New alert rule**.
109
+
1.In the Azure portal, go to a metrics page, and then select **New alert rule**.
97
110
98
-
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" alt-text="Screenshot showing 'New alert rule' button surrounded by a red box." lightbox="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" :::
111
+
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" alt-text="Screenshot showing 'New alert rule' button surrounded by a red box." lightbox="./media/how-to-monitor-online-endpoints/online-endpoints-new-alert-rule.png" :::
99
112
100
-
1. Select a condition name to specify when your alert should be triggered.
113
+
1.In the Select a signal window, select the signal that you want to create an alert for, and then select **Apply**.
101
114
102
-
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-configure-signal-logic.png" alt-text="Screenshot showing 'Configure signal logic' button surrounded by a red box." lightbox="./media/how-to-monitor-online-endpoints/online-endpoints-configure-signal-logic.png" :::
115
+
1. In the Create an alert rule page, enter a threshold, and edit any other settings that you want to adjust. For more information about alert rule settings, see [Configure the alert rule conditions](/azure/azure-monitor/alerts/alerts-create-metric-alert-rule#configure-the-alert-rule-conditions). Then select **Next: Actions**.
103
116
104
-
1. Select **Add action groups** > **Create action groups** to specify what should happen when your alert is triggered.
117
+
:::image type="content" source="./media/how-to-monitor-online-endpoints/configure-alert-rule.png" alt-text="Screenshot showing 'New alert rule' button surrounded by a red box." lightbox="./media/how-to-monitor-online-endpoints/configure-alert-rule.png" :::
105
118
106
-
1.Choose **Create alert rule**to finish creating your alert.
119
+
1.In the Select action groups window, create or select an action group to specify what happens when your alert is triggered. For more information, see [Configure the alert rule details](/azure/azure-monitor/alerts/alerts-create-metric-alert-rule#configure-the-alert-rule-details).
107
120
108
-
For more information, see [Create Azure Monitor alert rules](/azure/azure-monitor/alerts/alerts-create-new-alert-rule).
121
+
1. Choose **Review + Create** to finish creating your alert.
109
122
110
-
### Enable autoscale based on metrics
123
+
### Scale automatically based on metrics
111
124
112
-
You can enable autoscale of deployments using metrics using UI or code. When you use code (either CLI or SDK), you can use Metrics IDs listed in the table of [available metrics](#available-metrics)in condition for triggering autoscaling. For more information, see [Autoscaling online endpoints](how-to-autoscale-endpoints.md).
125
+
You can configure deployments to scale automatically based on metrics. To turn on the autoscale feature, you can use the UI or code. The options for code are the Azure Machine Learning CLI and the Azure Machine Learning SDK for Python. When you use code, you provide the IDs of metrics in the conditions for triggering automatic scaling. For those IDs, you can use the metrics that the table lists in the [Available metrics](#available-metrics)section. For more information, see [Autoscaling online endpoints](how-to-autoscale-endpoints.md).
113
126
114
127
## Logs
115
128
116
-
There are three logs that can be enabled for online endpoints:
129
+
There are three logs that you can turn on for online endpoints:
117
130
118
-
***AmlOnlineEndpointTrafficLog**: You could choose to enable traffic logs if you want to check the information of your request. Below are some cases:
131
+
***AmlOnlineEndpointTrafficLog**: This traffic log provides a way for you to check the information of a request to the endpoint. You can use this log in the following cases:
119
132
120
-
* If the response isn't 200, check the value of the column "ResponseCodeReason" to see what happened. Also check the reason in the "HTTPS status codes" section of the [Troubleshoot online endpoints](how-to-troubleshoot-online-endpoints.md#http-status-codes)article.
133
+
* If the request response isn't 200, check the value of the `ResponseCodeReason` column to see the reason. Also check the reason in [HTTPS status codes](how-to-troubleshoot-online-endpoints.md#http-status-codes), in the article about troubleshooting online endpoints.
121
134
122
135
* You could check the response code and response reason of your model from the column "ModelStatusCode" and "ModelStatusReason".
123
136
@@ -153,22 +166,33 @@ There are three logs that can be enabled for online endpoints:
153
166
| Killing | Stopping container inference-server
154
167
| Killing | Stopping container model-mount
155
168
156
-
### How to enable/disable logs
169
+
### Turn logs on or off
157
170
158
171
> [!IMPORTANT]
159
172
> Logging uses Azure Log Analytics. If you do not currently have a Log Analytics workspace, you can create one using the steps in [Create a Log Analytics workspace in the Azure portal](/azure/azure-monitor/logs/quick-create-workspace#create-a-workspace).
160
173
161
174
1. In the [Azure portal](https://portal.azure.com), go to the resource group that contains your endpoint and then select the endpoint.
162
-
1. From the **Monitoring** section on the left of the page, select **Diagnostic settings** and then **Add settings**.
163
-
1. Select the log categories to enable, select **Send to Log Analytics workspace**, and then select the Log Analytics workspace to use. Finally, enter a **Diagnostic setting name** and select **Save**.
164
175
165
-
:::image type="content" source="./media/how-to-monitor-online-endpoints/diagnostic-settings.png" alt-text="Screenshot of the diagnostic settings dialog.":::
176
+
1. Under **Monitoring**, select **Diagnostic settings**, and then select **Add diagnostic setting**.
177
+
178
+
1. In the Diagnostic setting window, enter the following information:
179
+
- Next to **Diagnostic setting name**, enter a name for your setting.
180
+
- Select the log categories that you want to turn on.
181
+
- Select **Send to Log Analytics workspace**, and then select the subscription and the Log Analytics workspace to use.
182
+
183
+
:::image type="content" source="./media/how-to-monitor-online-endpoints/diagnostic-settings.png" alt-text="Screenshot of the diagnostic settings dialog.":::
184
+
185
+
1. Select **Save**.
166
186
167
187
> [!IMPORTANT]
168
-
> It may take up to an hour for the connection to the Log Analytics workspace to be enabled. Wait an hour before continuing with the next steps.
169
-
170
-
1. Submit scoring requests to the endpoint. This activity should create entries in the logs.
188
+
> It may take up to an hour for the connection to the Log Analytics workspace to be enabled. Wait an hour before continuing with the steps in the next section.
189
+
190
+
### View logs
191
+
192
+
1. Submit scoring requests to the endpoint to create entries in the logs.
193
+
171
194
1. From either the online endpoint properties or the Log Analytics workspace, select **Logs** from the left of the screen.
195
+
172
196
1. Close the **Queries** dialog that automatically opens, and then double-click the **AmlOnlineEndpointConsoleLog**. If you don't see it, use the **Search** field.
173
197
174
198
:::image type="content" source="./media/how-to-monitor-online-endpoints/online-endpoints-log-queries.png" alt-text="Screenshot showing the log queries.":::
0 commit comments