initial

Author: EdB-MSFT

articles/azure-monitor/autoscale/autoscale-diagnostics.md

@@ -0,0 +1,249 @@
+---
+title: Autoscale in Azure using a custom metric
+description: Learn how to scale your web app by using custom metrics in the Azure portal.
+author: EdB-MSFT
+ms.author: edbaynash
+ms.service: azure-monitor
+ms.subservice: autoscale
+ms.topic: how-to
+ms.date: 06/22/2022
+ms.reviewer: akkumari
+
+# Customer intent: As a dev opps admin I want to collect and analyze autoscale metrics and logs
+---
+
+>>> Where is the flapping logs ?
+
+
+# Diagnostic settings in Autoscale
+
+Autoscale has two log categories and a set of metrics which can be enabled via the **Diagnostics settings** tab on the autoscale settings page.
+
+The two categories are 
+* [Autoscale Evaluations](https://learn.microsoft.com/en-us/azure/azure-monitor/reference/tables/autoscaleevaluationslog) containing log data relating to rule evaluation.
+* [Autoscale Scale Actions](https://learn.microsoft.com/azure/azure-monitor/reference/tables/autoscalescaleactionslog) log data relating to each scale event. 
+
+
+Information about Autoscale Metrics cn be found in the [Supported metrics](../essentials/metrics-supported#microsoftinsightsautoscalesettings) reference.
+
+Both the logs and metrics can be sent to a variety of destinations including:
+* Log Analytics workspaces
+* Storage accounts
+* Event hubs
+* Partner solutions
+
+For mor information on diagnostics see [Diagnostic settings in Azure Monitor](https://learn.microsoft.com/en-us/azure/azure-monitor/essentials/diagnostic-settings?tabs=portal)
+
+## Resource log schemas 
+
+Following are the general formats for autoscale resource logs with example data included. Not all examples below are properly formed JSON because they may include multiple values that could be valid for a given field. 
+
+Use events of this type to troubleshoot problems you may be having with autoscale. For more information, see [Troubleshooting autoscale problems](autoscale-troubleshoot.md).
+
+## Autoscale Evaluations Log
+The following schemas appear in the autoscale evaluations log.
+
+### Profile evaluation
+
+Recorded when autoscale first looks at an autoscale profile
+
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": ["FixedDateProfileEvaluation", "RecurrentProfileEvaluation", "DefaultProfileEvaluation"],
+  "category": "AutoscaleEvaluations",
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "profile": "defaultProfile",
+    "profileSelected": [true, false]
+  }
+}
+```
+
+### Profile cooldown evaluation
+
+Recorded when autoscale evaluates if it should not do a scale because of a cool down period. 
+
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": "ScaleRuleCooldownEvaluation",
+  "category": "AutoscaleEvaluations",
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "selectedProfile": "defaultProfile",
+    "scaleDirection": ["Increase", "Decrease"]
+    "lastScaleActionTime": "2018-09-10 18:08:00.6132593",
+    "cooldown": "00:30:00",
+    "evaluationTime": "2018-09-10 18:11:00.6132593",
+    "skipRuleEvaluationForCooldown": true
+  }
+}
+```
+
+### Rule evaluation
+
+Recorded when autoscale first starts evaluating a particular scale rule. 
+
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": "ScaleRuleEvaluation",
+  "category": "AutoscaleEvaluations",
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "metricName": "Percentage CPU",
+    "metricNamespace": "",
+    "timeGrain": "00:01:00",
+    "timeGrainStatistic": "Average",
+    "timeWindow": "00:10:00",
+    "timeAggregationType": "Average",
+    "operator": "GreaterThan",
+    "threshold": 70,
+    "observedValue": 25,
+    "estimateScaleResult": ["Triggered", "NotTriggered", "Unknown"]
+  }
+}
+```
+
+### Metric evaluation
+
+Recorded when autoscale evaluated the metric being used to trigger a scale action. 
+
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": "MetricEvaluation",
+  "category": "AutoscaleEvaluations",
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "metricName": "Percentage CPU",
+    "metricNamespace": "",
+    "timeGrain": "00:01:00",
+    "timeGrainStatistic": "Average",
+    "startTime": "2018-09-10 18:00:00.43833793",
+    "endTime": "2018-09-10 18:10:00.43833793",
+    "data": [0.33333333333333331,0.16666666666666666,1.0,0.33333333333333331,2.0,0.16666666666666666,9.5]
+  }
+}
+```
+
+### Instance count evaluation
+
+Recorded when autoscale evaluates the number of instances already running in preparation for deciding if it should start more, shut down some, or do nothing. 
+
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": "InstanceCountEvaluation",
+  "category": "AutoscaleEvaluations",
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "currentInstanceCount": 20,
+    "minimumInstanceCount": 15,
+    "maximumInstanceCount": 30,
+    "defaultInstanceCount": 20
+  }
+}
+```
+
+### Scale action evaluation
+
+Recorded when autoscale starts evaluation if a scale action should take place. 
+
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": "ScaleActionOperationEvaluation",
+  "category": "AutoscaleEvaluations",
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "lastScaleActionOperationId": "378ejr-7yye-892d-17dd-92ndijfe1738",
+    "lastScaleActionOperationStatus": ["InProgress", "Timeout"]
+	"skipCurrentAutoscaleEvaluation": [true, false]
+  }
+}
+```
+
+### Instance update evaluation
+
+Recorded when autoscale updates the number of compute instances running, either up or down.
+
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": "InstanceUpdateEvaluation",
+  "category": "AutoscaleEvaluations",
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "currentInstanceCount": 20,
+    "newInstanceCount": 21,
+    "shouldUpdateInstance": [true, false],
+    "reason": ["Scale down action triggered", "Scale up to default instance count", ...]
+  }
+}
+```
+
+## Autoscale Scale Actions Log
+
+The following schemas appear in the autoscale evaluations log.
+
+
+### Scale action
+
+Recorded when autoscale initiates a scale action, either up or down. 
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": "InstanceScaleAction",
+  "category": "AutoscaleScaleActions",
+  "resultType": ["Succeeded", "InProgress", "Failed"],
+  "resultDescription": ["Create async operation job failed", ...]
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "currentInstanceCount": 20,
+    "newInstanceCount": 21,
+    "scaleDirection": ["Increase", "Decrease"],
+    ["createdAsyncScaleActionJob": [true, false],]
+    ["createdAsyncScaleActionJobId": "378ejr-7yye-892d-17dd-92ndijfe1738",]
+  }
+}
+```
+
+### Scale action tracking
+
+Recorded at different intervals of an instance scale action.
+
+```json
+{
+  "time": "2018-09-10 18:12:00.6132593",
+  "resourceId": "/SUBSCRIPTIONS/BA13C41D-C957-4774-8A37-092D62ACFC85/RESOURCEGROUPS/AUTOSCALETRACKING12042017/PROVIDERS/MICROSOFT.INSIGHTS/AUTOSCALESETTINGS/DEFAULTSETTING",
+  "operationName": "InstanceScaleAction",
+  "category": "AutoscaleScaleActions",
+  "correlationId": "e8f67045-f381-445d-bc2d-eeff81ec0d77",
+  "property": {
+    "targetResourceId": "/subscriptions/d45c994a-809b-4cb3-a952-e75f8c488d23/resourceGroups/RingAhoy/providers/Microsoft.Web/serverfarms/ringahoy",
+    "scaleActionOperationId": "378ejr-7yye-892d-17dd-92ndijfe1738",
+    "scaleActionOperationStatus": ["InProgress", "Timeout", "Canceled", ...],
+    "scaleActionMessage": ["Scale action is inprogress", ...]
+  }
+}
+```
+
+