You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-monitor-online-endpoints.md
+13-13Lines changed: 13 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -104,25 +104,25 @@ There are three logs that can be enabled for online endpoints:
104
104
105
105
***AMLOnlineEndpointTrafficLog**: You could choose to enable traffic logs if you want to check the information of your request. Below are some cases:
106
106
107
-
* If the response isn't 200, you could check the value of the column “ResponseCodeReason” to see what might happen. And check the reason following the below link https://www.envoyproxy.io/docs/envoy/latest/configuration/http/http_conn_man/response_code_details
107
+
* If the response isn't 200, check the value of the column “ResponseCodeReason” to see what happened. Also check the reason in the "HTTPS status codes" section of the [Troubleshoot online endpoints](how-to-troubleshoot-online-endpoints.md#http-status-codes) article.
108
108
109
109
* You could check the response code and response reason of your model from the column “ModelStatusCode” and “ModelStatusReason”.
110
110
111
111
* You want to check the duration of the request like total duration, the request/response duration, and the delay caused by the network throttling. You could check it from the logs to see the breakdown latency.
112
112
113
113
* If you want to check how many requests or failed requests recently. You could also enable the logs.
114
114
115
-
***AMLOnlineEndpointConsoleLog**: Contains logs that the user containers output to the console. Below are some cases:
115
+
***AMLOnlineEndpointConsoleLog**: Contains logs that the containers output to the console. Below are some cases:
116
116
117
-
* If the user container fails to start, the console log may be useful for debugging.
117
+
* If the container fails to start, the console log may be useful for debugging.
118
118
119
-
* Monitor user container behavior, and make sure that all requests are correctly handled.
119
+
* Monitor container behavior and make sure that all requests are correctly handled.
120
120
121
121
* Write request IDs in the console log. Joining the request ID, the AMLOnlineEndpointConsoleLog, and AMLOnlineEndpointTrafficLog in the Log Analytics workspace, you can trace a request from the network entry point of an online endpoint to the container.
122
122
123
-
*Users may also use this log for performance analysis in determining the time required by the model to process each request.
123
+
*You may also use this log for performance analysis in determining the time required by the model to process each request.
124
124
125
-
***AMLOnlineEndpointEventLog**: Contains event information regarding the user container’s life cycle. Currently, we provide information on the following types of events:
125
+
***AMLOnlineEndpointEventLog**: Contains event information regarding the container’s life cycle. Currently, we provide information on the following types of events:
126
126
127
127
| Name | Message |
128
128
| ----- | ----- |
@@ -185,17 +185,17 @@ The following tables provide details on the data stored in each log:
185
185
| EndpointName | The name of the online endpoint.
186
186
| DeploymentName | The name of the online deployment.
187
187
| Protocol | The protocol of the request.
188
-
| ResponseCode | The final response code returned to the user.
189
-
| ResponseCodeReason | The final response code reason returned to the user.
188
+
| ResponseCode | The final response code returned to the client.
189
+
| ResponseCodeReason | The final response code reason returned to the client.
190
190
| ModelStatusCode | The response status code from model.
191
191
| ModelStatusReason | The response status reason from model.
192
-
| RequestPayloadSize | The total bytes received from the user client.
193
-
| ResponsePayloadSize | The total bytes sent back to the user client.
192
+
| RequestPayloadSize | The total bytes received from the client.
193
+
| ResponsePayloadSize | The total bytes sent back to the client.
194
194
| UserAgent | The user-agent header of the request.
195
195
| XRequestId | The request ID generated by Azure Machine Learning for internal tracing.
196
-
| XMSClientRequestId | The tracking ID generated by user client.
197
-
| TotalDurationMs | Duration in milliseconds from the request start time to the last response byte sent back to the user client. If the user client disconnected, it measures from the start time to client disconnect time.
198
-
| RequestDurationMs | Duration in milliseconds from the request start time to the last byte of the request received from the user client.
196
+
| XMSClientRequestId | The tracking ID generated by the client.
197
+
| TotalDurationMs | Duration in milliseconds from the request start time to the last response byte sent back to the client. If the client disconnected, it measures from the start time to client disconnect time.
198
+
| RequestDurationMs | Duration in milliseconds from the request start time to the last byte of the request received from the client.
199
199
| ResponseDurationMs | Duration in milliseconds from the request start time to the first response byte read from the model.
200
200
| RequestThrottlingDelayMs | Delay in milliseconds in request data transfer due to network throttling.
201
201
| ResponseThrottlingDelayMs | Delay in milliseconds in response data transfer due to network throttling.
0 commit comments