|
| 1 | +--- |
| 2 | +title: Monitor Azure Synapse Analytics |
| 3 | +description: Start here to learn how to monitor Azure Synapse Analytics. |
| 4 | +ms.date: 03/25/2024 |
| 5 | +ms.custom: horz-monitor |
| 6 | +ms.topic: conceptual |
| 7 | +author: jonburchel |
| 8 | +ms.author: jburchel |
| 9 | +ms.service: synapse-analytics |
| 10 | +--- |
| 11 | + |
| 12 | +# Monitor Azure Synapse Analytics |
| 13 | + |
| 14 | +[!INCLUDE [horz-monitor-intro](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-intro.md)] |
| 15 | + |
| 16 | +## Synapse Analytics monitoring options |
| 17 | + |
| 18 | +You can collect and analyze metrics and logs for Azure Synapse Analytics built-in and serverless SQL pools, dedicated SQL pools, Azure Spark pools, and Data Explorer pools (preview). You can monitor current and historical activities for SQL, Apache Spark, pipelines and triggers, and integration runtimes. |
| 19 | + |
| 20 | +There are several ways to monitor activities in your Synapse Analytics workspace. |
| 21 | + |
| 22 | +### Synapse Studio |
| 23 | + |
| 24 | +Open Synapse Studio and navigate to the **Monitor** hub to see a history of all the activities in the workspace and which ones are active. |
| 25 | + |
| 26 | +- Under **Integration**, you can monitor pipelines, triggers, and integration runtimes. |
| 27 | +- Under **Activities**, you can monitor Spark and SQL activities. |
| 28 | + |
| 29 | +For more information about monitoring in Synapse Studio, see [Monitor your Synapse Workspace](../get-started-monitor.md). |
| 30 | + |
| 31 | +- For monitoring pipeline runs, see [Monitor pipeline runs in Synapse Studio](../monitoring/how-to-monitor-pipeline-runs.md). |
| 32 | +- For monitoring Apache Spark applications, see [Monitor Apache Spark applications in Synapse Studio](../monitoring/apache-spark-applications.md). |
| 33 | +- For monitoring SQL pools, see [Use Synapse Studio to monitor your SQL pools](../monitoring/how-to-monitor-sql-pools.md). |
| 34 | +- For monitoring SQL requests, see [Monitor SQL requests in Synapse Studio](../monitoring/how-to-monitor-sql-requests.md). |
| 35 | + |
| 36 | +### DMVs and Query Store |
| 37 | + |
| 38 | +To programmatically monitor Synapse SQL via T-SQL, Synapse Analytics provides a set of Dynamic Management Views (DMVs). These views are useful to troubleshoot and identify performance bottlenecks with your workload. For more information, see [DMVs](../sql/query-history-storage-analysis.md#dmvs) and [Monitor your Azure Synapse Analytics dedicated SQL pool workload using DMVs](sql-data-warehouse-manage-monitor.md). For the list of DMVs that apply to Synapse SQL, see [Dedicated SQL pool Dynamic Management Views (DMVs)](../sql/reference-tsql-system-views.md#dedicated-sql-pool-dynamic-management-views-dmvs). |
| 39 | + |
| 40 | +Query Store is a set of internal stores and DMVs that provide insight on query plan choice and performance. Query Store simplifies performance troubleshooting by helping find performance differences caused by query plan changes. For more information about enabling and using Query Store on Synapse Analytics databases, see [Query Store](../sql/query-history-storage-analysis.md#query-store). |
| 41 | + |
| 42 | +### Azure portal |
| 43 | + |
| 44 | +You can monitor Synapse Analytics workspaces and pools directly from their Azure portal pages. On the left sidebar menu, you can access the Azure **Activity log**, or select **Alerts**, **Metrics**, **Diagnostic settings**, **Logs**, or **Advisor recommendations** from the **Monitoring** section. This article provides more details about these options. |
| 45 | + |
| 46 | +[!INCLUDE [horz-monitor-resource-types](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-resource-types.md)] |
| 47 | + |
| 48 | +The resource types for Synapse Analytics include: |
| 49 | + |
| 50 | +- Microsoft.Synapse/workspaces |
| 51 | +- Microsoft.Synapse/workspaces/bigDataPools |
| 52 | +- Microsoft.Synapse/workspaces/kustoPools |
| 53 | +- Microsoft.Synapse/workspaces/scopePools |
| 54 | +- Microsoft.Synapse/workspaces/sqlPools |
| 55 | + |
| 56 | +For more information about the resource types for Azure Synapse Analytics, see [Azure Synapse Analytics monitoring data reference](../monitor-synapse-analytics-reference.md). |
| 57 | + |
| 58 | +[!INCLUDE [horz-monitor-data-storage](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-data-storage.md)] |
| 59 | + |
| 60 | +Synapse Analytics supports storing monitoring data in Azure Storage or Azure Data Lake Storage Gen 2. |
| 61 | + |
| 62 | +[!INCLUDE [horz-monitor-platform-metrics](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-platform-metrics.md)] |
| 63 | + |
| 64 | +For lists of available platform metrics for Synapse Analytics, see [Synapse Analytics monitoring data reference](../monitor-synapse-analytics-reference.md#metrics). |
| 65 | + |
| 66 | +In addition to Log Analytics, Synapse Analytics Apache Spark pools support Prometheus server metrics and Grafana dashboards. For more information, see [Monitor Apache Spark Applications metrics with Prometheus and Grafana](../spark/use-prometheus-grafana-to-monitor-apache-spark-application-level-metrics.md) and [Collect Apache Spark applications metrics using Prometheus APIs](../spark/connect-monitor-azure-synapse-spark-application-level-metrics.md). |
| 67 | + |
| 68 | +[!INCLUDE [horz-monitor-resource-logs](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-resource-logs.md)] |
| 69 | + |
| 70 | +For the available resource log categories, their associated Log Analytics tables, and the log schemas for Synapse Analytics, see [Synapse Analytics monitoring data reference](../monitor-synapse-analytics-reference.md#resource-logs). |
| 71 | + |
| 72 | +[!INCLUDE [horz-monitor-activity-log](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-activity-log.md)] |
| 73 | + |
| 74 | +[!INCLUDE [horz-monitor-analyze-data](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-analyze-data.md)] |
| 75 | + |
| 76 | +In addition to the basic tools, Synapse Analytics supports Query Store, DMVs, or Azure Data Explorer to analyze query history and performance. For a comparison of these analytics methods, see [Historical query storage and analysis in Azure Synapse Analytics](../sql/query-history-storage-analysis.md). |
| 77 | + |
| 78 | +[!INCLUDE [horz-monitor-external-tools](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-external-tools.md)] |
| 79 | + |
| 80 | +[!INCLUDE [horz-monitor-kusto-queries](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-kusto-queries.md)] |
| 81 | + |
| 82 | +### Sample queries |
| 83 | + |
| 84 | +**Activity Log query for failed operations**: Lists all reports of failed operations over the past hour. |
| 85 | + |
| 86 | +```kusto |
| 87 | +AzureActivity |
| 88 | +| where TimeGenerated > ago(1h) |
| 89 | +| where ActivityStatus == "Failed" |
| 90 | +``` |
| 91 | + |
| 92 | +**Synapse Link table fail events**: Displays failed Synapse Link table events. |
| 93 | + |
| 94 | +```kusto |
| 95 | +SynapseLinkEvent |
| 96 | +| where OperationName == "TableFail" |
| 97 | +| limit 100 |
| 98 | +``` |
| 99 | + |
| 100 | +[!INCLUDE [horz-monitor-alerts](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-alerts.md)] |
| 101 | + |
| 102 | +### Synapse Analytics alert rules |
| 103 | + |
| 104 | +The following table lists some suggested alerts for Synapse Analytics. These alerts are just examples. You can set alerts for any metric, log entry, or activity log entry listed in the [Synapse Analytics monitoring data reference](../monitor-synapse-analytics-reference.md). |
| 105 | + |
| 106 | +| Alert type | Condition | Description | |
| 107 | +|:---|:---|:---| |
| 108 | +| Metric| TempDB 75% | Maximum local tempdb used percentage greater than or equal to 75% of threshold value | |
| 109 | +| Metric| Data Warehouse Unit (DWU) Usage near 100% | Average DWU used percentage greater than 95% for 1 hour | |
| 110 | +| Log Analytics | SynapseSqlPoolRequestSteps | ShuffleMoveOperation over 10 million rows | |
| 111 | + |
| 112 | +For more details about creating these and other recommended alert rules, see [Create alerts for your Synapse Dedicated SQL Pool](https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/create-alerts-for-your-synapse-dedicated-sql-pool/ba-p/3773256). |
| 113 | + |
| 114 | +[!INCLUDE [horz-monitor-advisor-recommendations](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-advisor-recommendations.md)] |
| 115 | + |
| 116 | +Synapse Analytics dedicated SQL pool provides Azure Advisor recommendations to ensure your data warehouse workload is consistently optimized for performance. For more information, see [Azure Advisor recommendations for dedicated SQL pool in Azure Synapse Analytics](sql-data-warehouse-concept-recommendations.md). |
| 117 | + |
| 118 | +## Related content |
| 119 | + |
| 120 | +- For information about monitoring in Synapse Studio, see [Monitor your Synapse Workspace](../get-started-monitor.md). |
| 121 | +- For a comparison of Log Analytics, Query Store, DMVs, and Azure Data Explorer analytics, see [Historical query storage and analysis in Azure Synapse Analytics](../sql/query-history-storage-analysis.md). |
| 122 | +- For information about Prometheus metrics and Grafana dashboards for Synapse Analytics Apache Spark pools, see [Monitor Apache Spark Applications metrics with Prometheus and Grafana](../spark/use-prometheus-grafana-to-monitor-apache-spark-application-level-metrics.md). |
| 123 | +- For a reference of the Azure Monitor metrics, logs, and other important values created for Synapse Analytics, see [Synapse Analytics monitoring data reference](../monitor-synapse-analytics-reference.md). |
| 124 | +- For general details on monitoring Azure resources with Azure Monitor, see [Monitor Azure resources with Azure Monitor](/azure/azure-monitor/essentials/monitor-azure-resource). |
0 commit comments