You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/synapse-analytics/monitor-synapse-analytics-reference.md
+15-23Lines changed: 15 additions & 23 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -44,47 +44,39 @@ The following table lists the metrics available for the Microsoft.Synapse/worksp
44
44
45
45
#### Details
46
46
47
-
- Dedicated SQL pool measures performance in compute data warehouse units (cDWUs). Rather than surfacing details of individual nodes such as memory per node or number of CPUs per node, the intent behind emitting metrics such as `MemoryUsedPercent` and `CPUPercent` is to show general usage trend over a period of time. These trends help administrators understand how an instance of dedicated SQL pool is utilized, and changes in footprint of memory and/or CPU could be a trigger for actions such as scale-up or scale-down of cDWUs, or investigating queries that might require optimization.
47
+
- Dedicated SQL pool measures performance in compute data warehouse units (DWUs). Rather than surfacing details of individual nodes such as memory per node or number of CPUs per node, metrics such as `MemoryUsedPercent` and `CPUPercent` show general usage trend over a period of time. These trends help administrators understand how a dedicated SQL pool instance is utilized. Changes in memory or CPU footprint could be a trigger for actions such as scale-up or scale-down of DWUs, or investigating queries that might require optimization.
48
48
49
-
DWU used represents only a high-level representation of usage across the SQL pool and isn't a comprehensive indicator of utilization. To determine whether to scale up or down, consider all factors that DWU can impact, such as concurrency, memory, `tempdb`, and adaptive cache capacity. [Run your workload at different DWU settings](sql-data-warehouse-manage-compute-overview.md#finding-the-right-size-of-data-warehouse-units) to determine what works best to meet your business objectives.
49
+
`DWUUsed`represents only high-level usage across the SQL pool and isn't a comprehensive indicator of utilization. To determine whether to scale up or down, consider all factors that DWU can impact, such as concurrency, memory, tempdb size, and adaptive cache capacity. [Run your workload at different DWU settings](sql-data-warehouse/sql-data-warehouse-manage-compute-overview.md#finding-the-right-size-of-data-warehouse-units) to determine what works best to meet your business objectives.
50
50
51
-
- Memory percentage reflects utilization even if the data warehouse is idle, not active workload memory consumption. Track this metric along with `tempdb` and Gen2 cache to decide whether you need to scale for more cache capacity to increase workload performance.
51
+
- Memory percentage reflects utilization even if the data warehouse is idle, not active workload memory consumption. Track this metric along with tempdb size and Gen2 cache to decide whether you need to scale for more cache capacity to increase workload performance.
52
52
53
53
- Failed and successful connections are reported for a particular data warehouse, not for the server itself.
Use the `Result` dimension of the `IntegrationActivityRunsEnded`, `IntegrationPipelineRunsEnded`, `IntegrationTriggerRunsEnded`, and `BuiltinSqlPoolDataRequestsEnded` metrics to filter by Succeeded, Failed, or Cancelled final state.
63
+
Use the `Result` dimension of the `IntegrationActivityRunsEnded`, `IntegrationPipelineRunsEnded`, `IntegrationTriggerRunsEnded`, and `BuiltinSqlPoolDataRequestsEnded` metrics to filter by `Succeeded`, `Failed`, or `Canceled` final state.
There are several ways to monitor activities in your Synapse Analytics workspace. You can collect and analyze metrics and logs for built-in and serverless SQL pools, dedicated SQL pools, Azure Spark pools, and Data Explorer pools (preview). You can monitor current and historical activities for SQL, Apache Spark, pipelines and triggers, and integration runtimes.
18
+
You can collect and analyze metrics and logs for Azure Synapse Analytics built-in and serverless SQL pools, dedicated SQL pools, Azure Spark pools, and Data Explorer pools (preview). You can monitor current and historical activities for SQL, Apache Spark, pipelines and triggers, and integration runtimes. There are several ways to monitor activities in your Synapse Analytics workspace.
19
19
20
20
### Synapse Studio
21
21
@@ -26,10 +26,10 @@ Open Synapse Studio and navigate to the **Monitor** hub to see a history of all
26
26
27
27
For more information about monitoring in Synapse Studio, see [Monitor your Synapse Workspace](get-started-monitor.md).
28
28
29
-
- For information on monitoring pipeline runs, see [Monitor pipeline runs in Synapse Studio](monitoring/how-to-monitor-pipeline-runs.md).
30
-
- For information on monitoring Apache Spark applications, see [Monitor Apache Spark applications in Synapse Studio](monitoring/apache-spark-applications.md).
31
-
- For information on monitoring SQL pools, see [Use Synapse Studio to monitor your SQL pools](monitoring/how-to-monitor-sql-pools.md).
32
-
- For information on monitoring SQL requests, see [Monitor SQL requests in Synapse Studio](monitoring/how-to-monitor-sql-requests.md).
29
+
- For monitoring pipeline runs, see [Monitor pipeline runs in Synapse Studio](monitoring/how-to-monitor-pipeline-runs.md).
30
+
- For monitoring Apache Spark applications, see [Monitor Apache Spark applications in Synapse Studio](monitoring/apache-spark-applications.md).
31
+
- For monitoring SQL pools, see [Use Synapse Studio to monitor your SQL pools](monitoring/how-to-monitor-sql-pools.md).
32
+
- For monitoring SQL requests, see [Monitor SQL requests in Synapse Studio](monitoring/how-to-monitor-sql-requests.md).
33
33
34
34
### DMVs and Query Store
35
35
@@ -61,46 +61,62 @@ Synapse Analytics supports storing monitoring data in Azure Storage or Azure Dat
61
61
62
62
For lists of available platform metrics for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md#metrics).
63
63
64
-
Synapse Analytics Apache Spark pools support Prometheus metrics and Grafana dashboards. For more information, see [Monitor Apache Spark Applications metrics with Prometheus and Grafana](spark/use-prometheus-grafana-to-monitor-apache-spark-application-level-metrics.md).
64
+
In addition to Log Analytics, Synapse Analytics Apache Spark pools support Prometheus server metrics and Grafana dashboards. For more information, see [Monitor Apache Spark Applications metrics with Prometheus and Grafana](spark/use-prometheus-grafana-to-monitor-apache-spark-application-level-metrics.md) and [Collect Apache Spark applications metrics using Prometheus APIs](connect-monitor-azure-synapse-spark-application-level-metrics.md).
For the available resource log categories, their associated Log Analytics tables, and the logs schemas for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md#resource-logs).
68
+
For the available resource log categories, their associated Log Analytics tables, and the log schemas for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md#resource-logs).
For a comparison of using Query Store, DMVs, Log Analytics, or Azure Data Explorer to analyze query history and performance, see [Historical query storage and analysis in Azure Synapse Analytics](query-history-storage-analysis.md).
74
+
In addition to the basic tools, Synapse Analytics supports Query Store, DMVs, or Azure Data Explorer to analyze query history and performance. For a comparison of these analytics methods, see [Historical query storage and analysis in Azure Synapse Analytics](sql/query-history-storage-analysis.md).
The following table lists some suggested alerts for Synapse Analytics. These alerts are just examples. You can set alerts for any metric, log entry, or activity log entry that's listed in the [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md).
102
+
The following table lists some suggested alerts for Synapse Analytics. These alerts are just examples. You can set alerts for any metric, log entry, or activity log entry listed in the [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md).
93
103
94
104
| Alert type | Condition | Description |
95
105
|:---|:---|:---|
96
106
| Metric| TempDB 75% | Maximum local tempdb used percentage greater than or equal to 75% of threshold value |
97
-
| Metric| DWU Usage near 100% for 1 hour | Average DWU used percentage greater than 95% for one hour |
107
+
| Metric|Data Warehouse Unit (DWU) Usage near 100% | Average DWU used percentage greater than 95% for 1 hour |
98
108
| Log Analytics | SynapseSqlPoolRequestSteps | ShuffleMoveOperation over 10 million rows |
99
109
100
110
For more details about creating these and other recommended alert rules, see [Create alerts for your Synapse Dedicated SQL Pool](https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/create-alerts-for-your-synapse-dedicated-sql-pool/ba-p/3773256).
Synapse Analytics dedicated SQL pool provides Azure Advisor recommendations to ensure your data warehouse workload is consistently optimized for performance. For more information, see [Azure Advisor recommendations for dedicated SQL pool in Azure Synapse Analytics](sql-data-warehouse/sql-data-warehouse-concept-recommendations.md).
115
+
104
116
## Related content
105
-
- For a reference of the metrics, logs, and other important values created for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md).
117
+
118
+
- For information about monitoring in Synapse Studio, see [Monitor your Synapse Workspace](get-started-monitor.md).
119
+
- For a comparison of Log Analytics, Query Store, DMVs, and Azure Data Explorer analytics, see [Historical query storage and analysis in Azure Synapse Analytics](sql/query-history-storage-analysis.md).
120
+
- For information about Prometheus metrics and Grafana dashboards for Synapse Analytics Apache Spark pools, see [Monitor Apache Spark Applications metrics with Prometheus and Grafana](spark/use-prometheus-grafana-to-monitor-apache-spark-application-level-metrics.md).
121
+
- For a reference of the Azure Monitor metrics, logs, and other important values created for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md).
106
122
- For general details on monitoring Azure resources with Azure Monitor, see [Monitor Azure resources with Azure Monitor](/azure/azure-monitor/essentials/monitor-azure-resource).
0 commit comments