Merge pull request #203799 from ggailey777/monitoring-updates

v-stsavell · web-flow · commit 437fe4423063 · 2022-07-12T15:40:01.000-05:00
[Functions][Horizontal] Monitoring updates
diff --git a/.openpublishing.redirection.json b/.openpublishing.redirection.json
@@ -6911,6 +6911,11 @@
       "redirect_url": "/azure/azure-functions/functions-bindings-event-hubs-output",
       "redirect_document_id": false
     },
+    {
+      "source_path_from_root": "/articles/azure-functions/monitor-metrics.md",
+      "redirect_url": "/azure/azure-functions/monitor-functions",
+      "redirect_document_id": false
+    },
     {
       "source_path_from_root": "/articles/azure-functions/functions-bindings-errors.md",
       "redirect_url": "/azure/azure-functions/functions-bindings-error-pages",
diff --git a/articles/azure-functions/TOC.yml b/articles/azure-functions/TOC.yml
@@ -235,7 +235,7 @@
           displayName: secure, ssl
         - name: Security baseline
           href: /security/benchmark/azure/baselines/functions-security-baseline?toc=/azure/azure-functions/TOC.json
-    - name: Monitoring
+    - name: Monitor function executions
       href: functions-monitoring.md
       displayName: App Insights, Application Insights, logs, logging
     - name: Diagnostics
@@ -413,14 +413,15 @@
           href: functions-move-across-regions.md
     - name: Monitor
       items:
+        - name: Monitor function apps with Azure Monitor
+          href: monitor-functions.md
+          displayName: monitor metrics
         - name: Configure monitoring
           href: configure-monitoring.md
           displayName: App Insights, Application Insights, logs, logging
         - name: Analyze telemetry data
           href: analyze-telemetry-data.md
           displayName: App Insights, Application Insights, Kusto
-        - name: Monitor metrics
-          href: monitor-metrics.md
         - name: Streaming logs
           href: streaming-logs.md
           displayName: monitoring
@@ -746,6 +747,8 @@
       href: functions-host-json.md
     - name: host.json 1.x reference
       href: functions-host-json-v1.md
+    - name: Monitoring data
+      href: monitor-functions-reference.md  
     - name: Networking FAQ
       href: functions-networking-faq.yml
 - name: Resources
diff --git a/articles/azure-functions/functions-best-practices.md b/articles/azure-functions/functions-best-practices.md
@@ -187,7 +187,7 @@ Premium plan is the recommended plan for reducing colds starts while maintaining
 
 ## Monitor effectively
 
-Azure Functions offers built-in integration with Azure Application Insights to monitor your function execution and traces written from your code. To learn more, see [Monitor Azure Functions](functions-monitoring.md). Azure Monitor also provides facilities for monitoring the health of the function app itself. To learn more, see [Using Azure Monitor Metric with Azure Functions](monitor-metrics.md).
+Azure Functions offers built-in integration with Azure Application Insights to monitor your function execution and traces written from your code. To learn more, see [Monitor Azure Functions](functions-monitoring.md). Azure Monitor also provides facilities for monitoring the health of the function app itself. To learn more, see [Monitoring with Azure Monitor](monitor-functions.md).
 
 You should be aware of the following considerations when using Application Insights integration to monitor your functions:
 
diff --git a/articles/azure-functions/functions-monitoring.md b/articles/azure-functions/functions-monitoring.md
@@ -1,21 +1,23 @@
 ---
-title: Monitor Azure Functions
-description: Learn how to use Azure Application Insights with Azure Functions to monitor function execution.
+title: Monitor executions in Azure Functions
+description: Learn how to use Azure Application Insights with Azure Functions to monitor function executions.
 ms.assetid: 501722c3-f2f7-4224-a220-6d59da08a320
 ms.topic: conceptual
-ms.date: 10/14/2020
+ms.date: 07/05/2022
 ms.custom: "devx-track-csharp, fasttrack-edit, contperf-fy21q2, devx-track-js"
 # Customer intent: As a developer, I want to understand what facilities are provided to help me monitor my functions so I can know if they're running correctly.
 ---
 
-# Monitor Azure Functions
+# Monitor executions in Azure Functions
 
-[Azure Functions](functions-overview.md) offers built-in integration with [Azure Application Insights](../azure-monitor/app/app-insights-overview.md) to monitor functions. This article provides an overview of the monitoring capabilities provided by Azure for monitoring Azure Functions.
+[Azure Functions](functions-overview.md) offers built-in integration with [Azure Application Insights](../azure-monitor/app/app-insights-overview.md) to monitor functions executions. This article provides an overview of the monitoring capabilities provided by Azure for monitoring Azure Functions.
 
 Application Insights collects log, performance, and error data. By automatically detecting performance anomalies and featuring powerful analytics tools, you can more easily  diagnose issues and better understand how your functions are used. These tools are designed to help you continuously improve performance and usability of your functions. You can even use Application Insights during local function app project development. For more information, see [What is Application Insights?](../azure-monitor/app/app-insights-overview.md).
 
 As Application Insights instrumentation is built into Azure Functions, you need a valid instrumentation key to connect your function app to an Application Insights resource. The instrumentation key is added to your application settings as you create your function app resource in Azure. If your function app doesn't already have this key, you can [set it manually](configure-monitoring.md#enable-application-insights-integration).  
 
+You can also monitor the function app itself by using Azure Monitor. To learn more, see [Monitoring Azure Functions with Azure Monitor](monitor-functions.md).
+
 ## Application Insights pricing and limits
 
 You can try out Application Insights integration with Azure Functions for free featuring a daily limit to how much data is processed for free.
@@ -107,23 +109,19 @@ Log streams can be viewed both in the portal and in most local development envir
 
 ## Diagnostic logs
 
-_This feature is in preview._ 
-
 Application Insights lets you export telemetry data to long-term storage or other analysis services.  
 
 Because Functions also integrates with Azure Monitor, you can also use diagnostic settings to send telemetry data to various destinations, including Azure Monitor logs. To learn more, see [Monitoring Azure Functions with Azure Monitor Logs](functions-monitor-log-analytics.md).
 
 ## Scale controller logs
 
-_This feature is in preview._ 
-
 The [Azure Functions scale controller](./event-driven-scaling.md#runtime-scaling) monitors instances of the Azure Functions host on which your app runs. This controller makes decisions about when to add or remove instances based on current performance. You can have the scale controller emit logs to Application Insights to better understand the decisions the scale controller is making for your function app. You can also store the generated logs in Blob storage for analysis by another service. 
 
 To enable this feature, you add an application setting named `SCALE_CONTROLLER_LOGGING_ENABLED` to your function app settings. To learn how, see [Configure scale controller logs](configure-monitoring.md#configure-scale-controller-logs).
 
 ## Azure Monitor metrics
 
-In addition to log-based telemetry data collected by Application Insights, you can also get data about how the function app is running from [Azure Monitor Metrics](../azure-monitor/essentials/data-platform-metrics.md). To learn more, see [Using Azure Monitor Metric with Azure Functions](monitor-metrics.md).
+In addition to log-based telemetry data collected by Application Insights, you can also get data about how the function app is running from [Azure Monitor Metrics](../azure-monitor/essentials/data-platform-metrics.md). To learn more, see [Monitoring with Azure Monitor](monitor-functions.md).
 
 ## Report issues
 
diff --git a/articles/azure-functions/monitor-functions-reference.md b/articles/azure-functions/monitor-functions-reference.md
@@ -0,0 +1,77 @@
+---
+title: Monitoring Azure Functions data reference
+description: Important reference material needed when you monitor Azure Functions
+ms.topic: reference
+ms.service: azure-functions
+ms.custom: subject-monitoring
+ms.date: 07/05/2022
+---
+
+# Monitoring Azure Functions data reference
+
+This reference applies to the use of Azure Monitor for monitoring function apps hosted in Azure Functions. See [Monitoring function app with Azure Monitor](monitor-functions.md) for details on using Azure Monitor to collect and analyze monitoring data from your function apps. 
+
+See [Monitor Azure Functions](functions-monitoring.md) for details on using Application Insights to collect and analyze log data from individual functions in your function app.
+
+## Metrics
+
+This section lists all the automatically collected platform metrics collected for Azure Functions.
+
+### Azure Functions specific metrics
+
+There are two metrics specific to Functions that are of interest:
+
+| Metric | Description |
+| ---- | ---- |
+| **FunctionExecutionCount** | Function execution count indicates the number of times your function app has executed. This value correlates to the number of times a function runs in your app. |
+| **FunctionExecutionUnits** | Function execution units are a combination of execution time and your memory usage.  Memory data isn't a metric currently available through Azure Monitor. However, if you want to optimize the memory usage of your app, can use the performance counter data collected by Application Insights. This metric isn't currently supported for Premium and Dedicated (App Service) plans running on Linux.|
+
+These metrics are used specifically when [estimating Consumption plan costs](functions-consumption-costs.md).
+
+### General App Service metrics
+
+Aside from Azure Functions specific metrics, the App Service platform implements more metrics, which you can use to monitor function apps. For the complete list, see [metrics available to App Service apps](../app-service/web-sites-monitor.md#understand-metrics) and [Monitoring App Service data reference](../app-service/monitor-app-service-reference.md#metrics).
+
+## Metric Dimensions
+
+For more information on what metric dimensions are, see [Multi-dimensional metrics](../azure-monitor/essentials/data-platform-metrics.md#multi-dimensional-metrics).
+
+Azure Functions doesn't have any metrics that contain dimensions.
+
+## Resource logs
+
+This section lists the types of resource logs you can collect for your function apps.
+
+| Log type | Description |
+|-|-|
+| FunctionAppLogs | Function app logs |
+
+For more information, see [Monitoring App Service data reference](../app-service/monitor-app-service-reference.md#resource-logs).
+
+For reference, see a list of [all resource logs category types supported in Azure Monitor](../azure-monitor/essentials/resource-logs-schema.md).
+
+## Azure Monitor Logs tables
+
+Azure Functions uses Kusto tables from Azure Monitor Logs. You can query the [FunctionAppLogs table](/azure/azure-monitor/reference/tables/functionapplogs) with Log Analytics. For more information, see the [Azure Monitor Log Table Reference](/azure/azure-monitor/reference/tables/tables-resourcetype#app-services).
+
+## Activity log
+
+The following table lists the operations related to Azure Functions that may be created in the Activity log. 
+
+| Operation | Description |
+|:---|:---|
+|Microsoft.web/sites/functions/listkeys/action | Return the [keys for the function](functions-bindings-http-webhook-trigger.md#authorization-keys).|
+|Microsoft.Web/sites/host/listkeys/action | Return the [host keys for the function app](functions-bindings-http-webhook-trigger.md#authorization-keys).|
+|Microsoft.Web/sites/host/sync/action | [Sync triggers](functions-deployment-technologies.md#trigger-syncing) operation.|
+|Microsoft.Web/sites/start/action| Function app started. |
+|Microsoft.Web/sites/stop/action| Function app stopped.|
+|Microsoft.Web/sites/write| Change a function app setting, such as runtime version or enable remote debugging.|
+
+You may also find logged operations that relate to the underlying App Service behaviors. For a more complete list, see [Resource Provider Operations](/azure/role-based-access-control/resource-provider-operations#microsoftweb).
+
+For more information on the schema of Activity Log entries, see [Activity Log schema](../azure-monitor/essentials/activity-log-schema.md).
+
+## See Also
+
+* See [Monitoring Azure Functions](monitor-functions.md) for a description of monitoring Azure Functions.
+* See [Monitoring Azure resources with Azure Monitor](../azure-monitor/essentials/monitor-azure-resource.md) for details on monitoring Azure resources.
diff --git a/articles/azure-functions/monitor-functions.md b/articles/azure-functions/monitor-functions.md
@@ -0,0 +1,115 @@
+---
+title: Monitoring Azure Functions
+description: Start here to learn how to monitor function apps running in Azure Functions using Azure Monitor
+ms.topic: how-to
+ms.service: azure-functions
+ms.custom: subject-monitoring
+ms.date: 07/05/2022
+---
+
+# Monitoring Azure Functions
+
+When you have critical applications and business processes relying on Azure resources, you want to monitor those resources for their availability, performance, and operation.
+
+This article describes the monitoring data generated by apps hosted in Azure Functions. Azure Functions uses [Azure Monitor](../azure-monitor/overview.md) to monitor the health of your function apps. If you're unfamiliar with the features of Azure Monitor common to all Azure services that use it, see [Monitoring Azure resources with Azure Monitor](../azure-monitor/essentials/monitor-azure-resource.md).
+
+Azure Functions uses Application Insights to collect and analyze log data from individual function executions in your function app. For more information, see [Monitor functions in Azure](functions-monitoring.md).
+
+## Monitoring data
+
+Azure Functions collects the same kinds of monitoring data as other Azure resources that are described in [Azure Monitor data collection](../azure-monitor/essentials/monitor-azure-resource.md#monitoring-data-from-azure-resources).
+
+See [Monitoring Azure Functions data reference](monitor-functions-reference.md) for detailed information on the metrics and logs metrics created by Azure Functions.
+
+## Collection and routing
+
+Platform metrics and the Activity log are collected and stored automatically, but can be routed to other locations by using a diagnostic setting.
+
+Resource Logs aren't collected and stored until you create a diagnostic setting and route them to one or more locations.
+
+See [Create diagnostic setting to collect platform logs and metrics in Azure](../azure-monitor/essentials/diagnostic-settings.md) for the detailed process for creating a diagnostic setting using the Azure portal, CLI, or PowerShell. When you create a diagnostic setting, you specify which categories of logs to collect. The categories for *Azure Functions* are listed in [Azure Functions monitoring data reference](monitor-functions-reference.md#resource-logs).
+
+The metrics and logs you can collect are discussed in the following sections.
+
+## Analyzing metrics
+
+You can analyze metrics for *Azure Functions* with metrics from other Azure services using metrics explorer by opening **Metrics** from the **Azure Monitor** menu. See [Getting started with Azure Metrics Explorer](../azure-monitor/essentials/metrics-getting-started.md) for details on using this tool.
+
+For a list of the platform metrics collected for Azure Functions, see [Monitoring *Azure Functions* data reference metrics](monitor-functions-reference.md#metrics).
+
+For reference, you can see a list of [all resource metrics supported in Azure Monitor](../azure-monitor/essentials/metrics-supported.md).
+
+The following examples use Monitor Metrics to help estimate the cost of running your function app on a Consumption plan. To learn more about estimating Consumption plan costs, see [Estimating Consumption plan costs](functions-consumption-costs.md).
+
+[!INCLUDE [functions-monitor-metrics-consumption](../../includes/functions-monitor-metrics-consumption.md)]  
+
+## Analyzing logs
+
+Data in Azure Monitor Logs is stored in tables where each table has its own set of unique properties.
+
+All resource logs in Azure Monitor have the same fields followed by service-specific fields. The common schema is outlined in [Azure Monitor resource log schema](../azure-monitor/essentials/resource-logs-schema.md). 
+
+The [Activity log](../azure-monitor/essentials/activity-log.md) is a type of platform log in Azure that provides insight into subscription-level events. You can view it independently or route it to Azure Monitor Logs, where you can do much more complex queries using Log Analytics.
+
+For a list of the types of resource logs collected for Azure Functions, see [Monitoring Azure Functions data reference](monitor-functions-reference.md#resource-logs)
+
+For a list of the tables used by Azure Monitor Logs and queryable by Log Analytics, see [Monitoring Azure Functions data reference](monitor-functions-reference.md#azure-monitor-logs-tables)
+
+### Sample Kusto queries
+
+> [!IMPORTANT]
+> When you select **Logs** from the Azure Functions menu, Log Analytics is opened with the query scope set to the current resource. This means that log queries will only include data from that resource. If you want to run a query that includes data from other resources or data from other Azure services, select **Logs** from the **Azure Monitor** menu. See [Log query scope and time range in Azure Monitor Log Analytics](../azure-monitor/logs/scope.md) for details.
+
+Following are queries that you can use to help you monitor your Azure Function.
+
+The following sample query can help you monitor all your functions app logs:
+
+```Kusto
+FunctionAppLogs
+| project TimeGenerated, HostInstanceId, Message, _ResourceId
+| order by TimeGenerated desc
+```
+
+The following sample query can help you monitor a specific functions app's logs:
+
+```Kusto
+FunctionAppLogs
+| where FunctionName == "<Function name>" 
+| order by TimeGenerated desc
+```
+
+The following sample query can help you monitor exceptions on a specific functions app's logs:
+
+```Kusto
+FunctionAppLogs
+| where ExceptionDetails != ""  
+| where FunctionName == "<Function name>" 
+| order by TimeGenerated desc
+```
+
+## Alerts
+
+Azure Monitor alerts proactively notify you when important conditions are found in your monitoring data. They allow you to identify and address issues in your system before your customers notice them. You can set alerts on [metrics](../azure-monitor/alerts/alerts-metric-overview.md), [logs](../azure-monitor/alerts/alerts-unified-log.md), and the [activity log](../azure-monitor/alerts/activity-log-alerts.md). Different types of alerts have benefits and drawbacks.
+
+If you're creating or running an application that run on Functions [Azure Monitor Application Insights](../azure-monitor/overview.md#application-insights) may offer other types of alerts.
+
+The following table lists common and recommended alert rules for Functions.
+
+| Alert type | Condition | Examples  |
+|:---|:---|:---|
+| Metric | Average connections| When number of connections exceed a set value|
+| Metric | HTTP 404| When HTTP 404 responses exceed a set value|
+| Metric | HTTP Server Errors| When HTTP 5xx errors exceed a set value|
+| Activity Log | Create or Update Web App | When app is created or updated|
+| Activity Log | Delete Web App | When app is deleted|
+| Activity Log | Restart Web App| When app is restarted|
+| Activity Log | Stop Web App| When app is stopped|
+
+## Next steps
+
+For more information about monitoring Azure Functions, see the following articles:
+
+* [Monitor Azure Functions](functions-monitoring.md) - details how-to monitor a function app.
+* [Monitoring Azure Functions data reference](monitor-functions-reference.md) - reference of the metrics, logs, and other important values created by your function app.
+* [Monitoring Azure resources with Azure Monitor](../azure-monitor/essentials/monitor-azure-resource.md) - details monitoring Azure resources.
+* [Analyze Azure Functions telemetry in Application Insights](analyze-telemetry-data.md) - details how-to view and query the data being collected from a function app.
diff --git a/articles/azure-functions/monitor-metrics.md b/articles/azure-functions/monitor-metrics.md
