Skip to content

Commit fdd9770

Browse files
committed
remove article
1 parent edf0ecd commit fdd9770

6 files changed

+62
-240
lines changed

articles/synapse-analytics/.openpublishing.redirection.synapse-analytics.json

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -724,6 +724,11 @@
724724
"source_path_from_root": "/articles/synapse-analytics/synapse-link/troubleshoot/troubleshoot-sql-snapshot-primary-key-column-order.md",
725725
"redirect_url": "/azure/synapse-analytics/synapse-link/synapse-link-for-sql-known-issues",
726726
"redirect_document_id": false
727+
},
728+
{
729+
"source_path_from_root": "/articles/synapse-analytics/monitoring/how-to-monitor-using-azure-monitor.md",
730+
"redirect_url": "/azure/synapse-analytics/monitor-synapse-analytics",
731+
"redirect_document_id": false
727732
}
728733
]
729734
}

articles/synapse-analytics/monitor-synapse-analytics-reference.md

Lines changed: 15 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -44,47 +44,39 @@ The following table lists the metrics available for the Microsoft.Synapse/worksp
4444

4545
#### Details
4646

47-
- Dedicated SQL pool measures performance in compute data warehouse units (cDWUs). Rather than surfacing details of individual nodes such as memory per node or number of CPUs per node, the intent behind emitting metrics such as `MemoryUsedPercent` and `CPUPercent` is to show general usage trend over a period of time. These trends help administrators understand how an instance of dedicated SQL pool is utilized, and changes in footprint of memory and/or CPU could be a trigger for actions such as scale-up or scale-down of cDWUs, or investigating queries that might require optimization.
47+
- Dedicated SQL pool measures performance in compute data warehouse units (DWUs). Rather than surfacing details of individual nodes such as memory per node or number of CPUs per node, metrics such as `MemoryUsedPercent` and `CPUPercent` show general usage trend over a period of time. These trends help administrators understand how a dedicated SQL pool instance is utilized. Changes in memory or CPU footprint could be a trigger for actions such as scale-up or scale-down of DWUs, or investigating queries that might require optimization.
4848

49-
DWU used represents only a high-level representation of usage across the SQL pool and isn't a comprehensive indicator of utilization. To determine whether to scale up or down, consider all factors that DWU can impact, such as concurrency, memory, `tempdb`, and adaptive cache capacity. [Run your workload at different DWU settings](sql-data-warehouse-manage-compute-overview.md#finding-the-right-size-of-data-warehouse-units) to determine what works best to meet your business objectives.
49+
`DWUUsed` represents only high-level usage across the SQL pool and isn't a comprehensive indicator of utilization. To determine whether to scale up or down, consider all factors that DWU can impact, such as concurrency, memory, tempdb size, and adaptive cache capacity. [Run your workload at different DWU settings](sql-data-warehouse/sql-data-warehouse-manage-compute-overview.md#finding-the-right-size-of-data-warehouse-units) to determine what works best to meet your business objectives.
5050

51-
- Memory percentage reflects utilization even if the data warehouse is idle, not active workload memory consumption. Track this metric along with `tempdb` and Gen2 cache to decide whether you need to scale for more cache capacity to increase workload performance.
51+
- Memory percentage reflects utilization even if the data warehouse is idle, not active workload memory consumption. Track this metric along with tempdb size and Gen2 cache to decide whether you need to scale for more cache capacity to increase workload performance.
5252

5353
- Failed and successful connections are reported for a particular data warehouse, not for the server itself.
5454

5555
[!INCLUDE [horz-monitor-ref-metrics-dimensions-intro](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-dimensions-intro.md)]
5656

5757
[!INCLUDE [horz-monitor-ref-metrics-dimensions](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-metrics-dimensions.md)]
5858

59-
**Microsoft.Synapse/workspaces**
59+
### Microsoft.Synapse/workspaces
6060

61-
Result, FailureType, Activity, ActivityType, Pipeline, Trigger,<br>
62-
EventType, TableName, LinkTableStatus, LinkConnectionName,<br>
63-
SQLPoolName, SQLDatabaseName, JobName, LogicalName, PartitionId, ProcessorInstance
61+
`Result`, `FailureType`, `Activity`, `ActivityType`, `Pipeline`, `Trigger`, `EventType`, `TableName`, `LinkTableStatus`, `LinkConnectionName`, `SQLPoolName`, `SQLDatabaseName`, `JobName`, `LogicalName`, `PartitionId`, `ProcessorInstance`
6462

65-
Use the `Result` dimension of the `IntegrationActivityRunsEnded`, `IntegrationPipelineRunsEnded`, `IntegrationTriggerRunsEnded`, and `BuiltinSqlPoolDataRequestsEnded` metrics to filter by Succeeded, Failed, or Cancelled final state.
63+
Use the `Result` dimension of the `IntegrationActivityRunsEnded`, `IntegrationPipelineRunsEnded`, `IntegrationTriggerRunsEnded`, and `BuiltinSqlPoolDataRequestsEnded` metrics to filter by `Succeeded`, `Failed`, or `Canceled` final state.
6664

67-
**Microsoft.Synapse/workspaces/bigDataPools**
65+
### Microsoft.Synapse/workspaces/bigDataPools
6866

69-
SubmitterId,<br>
70-
JobState, JobType, JobResult
67+
`SubmitterId`, `JobState`, `JobType`, `JobResult`
7168

72-
**Microsoft.Synapse/workspaces/kustoPools**
73-
Database, SealReason,<br>
74-
ComponentType, ComponentName,<br>
75-
ContinuousExportName, Result,<br>
76-
EventStatus, State, RoleInstance,<br>
77-
IngestionResultDetails, FailureKind,<br>
78-
MaterializedViewName, Kind, Result,<br>
79-
QueryStatus, ComponentType, CommandType
69+
### Microsoft.Synapse/workspaces/kustoPools
8070

81-
**Microsoft.Synapse/workspaces/scopePools**
71+
`Database`, `SealReason`, `ComponentType`, `ComponentName`, `ContinuousExportName`, `Result`, `EventStatus`, `State`, `RoleInstance`, `IngestionResultDetails`, `FailureKind`, `MaterializedViewName`, `Kind`, `Result`, `QueryStatus`, `ComponentType`, `CommandType`
8272

83-
JobType, JobResult
73+
### Microsoft.Synapse/workspaces/scopePools
8474

85-
**Microsoft.Synapse/workspaces/sqlPools**
75+
`JobType`, `JobResult`
8676

87-
IsUserDefined, Result
77+
### Microsoft.Synapse/workspaces/sqlPools
78+
79+
`IsUserDefined`, `Result`
8880

8981
[!INCLUDE [horz-monitor-ref-resource-logs](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-ref-resource-logs.md)]
9082

articles/synapse-analytics/monitor-synapse-analytics.md

Lines changed: 30 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -13,9 +13,9 @@ ms.service: synapse-analytics
1313

1414
[!INCLUDE [horz-monitor-intro](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-intro.md)]
1515

16-
## Monitoring methods
16+
## Synapse Analytics monitoring options
1717

18-
There are several ways to monitor activities in your Synapse Analytics workspace. You can collect and analyze metrics and logs for built-in and serverless SQL pools, dedicated SQL pools, Azure Spark pools, and Data Explorer pools (preview). You can monitor current and historical activities for SQL, Apache Spark, pipelines and triggers, and integration runtimes.
18+
You can collect and analyze metrics and logs for Azure Synapse Analytics built-in and serverless SQL pools, dedicated SQL pools, Azure Spark pools, and Data Explorer pools (preview). You can monitor current and historical activities for SQL, Apache Spark, pipelines and triggers, and integration runtimes. There are several ways to monitor activities in your Synapse Analytics workspace.
1919

2020
### Synapse Studio
2121

@@ -26,10 +26,10 @@ Open Synapse Studio and navigate to the **Monitor** hub to see a history of all
2626

2727
For more information about monitoring in Synapse Studio, see [Monitor your Synapse Workspace](get-started-monitor.md).
2828

29-
- For information on monitoring pipeline runs, see [Monitor pipeline runs in Synapse Studio](monitoring/how-to-monitor-pipeline-runs.md).
30-
- For information on monitoring Apache Spark applications, see [Monitor Apache Spark applications in Synapse Studio](monitoring/apache-spark-applications.md).
31-
- For information on monitoring SQL pools, see [Use Synapse Studio to monitor your SQL pools](monitoring/how-to-monitor-sql-pools.md).
32-
- For information on monitoring SQL requests, see [Monitor SQL requests in Synapse Studio](monitoring/how-to-monitor-sql-requests.md).
29+
- For monitoring pipeline runs, see [Monitor pipeline runs in Synapse Studio](monitoring/how-to-monitor-pipeline-runs.md).
30+
- For monitoring Apache Spark applications, see [Monitor Apache Spark applications in Synapse Studio](monitoring/apache-spark-applications.md).
31+
- For monitoring SQL pools, see [Use Synapse Studio to monitor your SQL pools](monitoring/how-to-monitor-sql-pools.md).
32+
- For monitoring SQL requests, see [Monitor SQL requests in Synapse Studio](monitoring/how-to-monitor-sql-requests.md).
3333

3434
### DMVs and Query Store
3535

@@ -61,46 +61,62 @@ Synapse Analytics supports storing monitoring data in Azure Storage or Azure Dat
6161

6262
For lists of available platform metrics for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md#metrics).
6363

64-
Synapse Analytics Apache Spark pools support Prometheus metrics and Grafana dashboards. For more information, see [Monitor Apache Spark Applications metrics with Prometheus and Grafana](spark/use-prometheus-grafana-to-monitor-apache-spark-application-level-metrics.md).
64+
In addition to Log Analytics, Synapse Analytics Apache Spark pools support Prometheus server metrics and Grafana dashboards. For more information, see [Monitor Apache Spark Applications metrics with Prometheus and Grafana](spark/use-prometheus-grafana-to-monitor-apache-spark-application-level-metrics.md) and [Collect Apache Spark applications metrics using Prometheus APIs](connect-monitor-azure-synapse-spark-application-level-metrics.md).
6565

6666
[!INCLUDE [horz-monitor-resource-logs](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-resource-logs.md)]
6767

68-
For the available resource log categories, their associated Log Analytics tables, and the logs schemas for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md#resource-logs).
68+
For the available resource log categories, their associated Log Analytics tables, and the log schemas for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md#resource-logs).
6969

7070
[!INCLUDE [horz-monitor-activity-log](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-activity-log.md)]
7171

7272
[!INCLUDE [horz-monitor-analyze-data](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-analyze-data.md)]
7373

74-
For a comparison of using Query Store, DMVs, Log Analytics, or Azure Data Explorer to analyze query history and performance, see [Historical query storage and analysis in Azure Synapse Analytics](query-history-storage-analysis.md).
74+
In addition to the basic tools, Synapse Analytics supports Query Store, DMVs, or Azure Data Explorer to analyze query history and performance. For a comparison of these analytics methods, see [Historical query storage and analysis in Azure Synapse Analytics](sql/query-history-storage-analysis.md).
7575

7676
[!INCLUDE [horz-monitor-external-tools](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-external-tools.md)]
7777

7878
[!INCLUDE [horz-monitor-kusto-queries](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-kusto-queries.md)]
7979

80-
### Synapse Link table fail events
81-
Display sample failed Synapse Link table events.
80+
### Sample queries
81+
82+
**Activity Log query for failed operations**: Lists all reports of failed operations over the past hour.
83+
84+
```kusto
85+
AzureActivity
86+
| where TimeGenerated > ago(1h)
87+
| where ActivityStatus == "Failed"
88+
```
89+
90+
**Synapse Link table fail events**: Displays failed Synapse Link table events.
8291

8392
```kusto
8493
SynapseLinkEvent
8594
| where OperationName == "TableFail"
8695
| limit 100
8796
```
97+
8898
[!INCLUDE [horz-monitor-alerts](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-alerts.md)]
8999

90100
### Synapse Analytics alert rules
91101

92-
The following table lists some suggested alerts for Synapse Analytics. These alerts are just examples. You can set alerts for any metric, log entry, or activity log entry that's listed in the [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md).
102+
The following table lists some suggested alerts for Synapse Analytics. These alerts are just examples. You can set alerts for any metric, log entry, or activity log entry listed in the [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md).
93103

94104
| Alert type | Condition | Description |
95105
|:---|:---|:---|
96106
| Metric| TempDB 75% | Maximum local tempdb used percentage greater than or equal to 75% of threshold value |
97-
| Metric| DWU Usage near 100% for 1 hour | Average DWU used percentage greater than 95% for one hour |
107+
| Metric| Data Warehouse Unit (DWU) Usage near 100% | Average DWU used percentage greater than 95% for 1 hour |
98108
| Log Analytics | SynapseSqlPoolRequestSteps | ShuffleMoveOperation over 10 million rows |
99109

100110
For more details about creating these and other recommended alert rules, see [Create alerts for your Synapse Dedicated SQL Pool](https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/create-alerts-for-your-synapse-dedicated-sql-pool/ba-p/3773256).
101111

102112
[!INCLUDE [horz-monitor-advisor-recommendations](~/reusable-content/ce-skilling/azure/includes/azure-monitor/horizontals/horz-monitor-advisor-recommendations.md)]
103113

114+
Synapse Analytics dedicated SQL pool provides Azure Advisor recommendations to ensure your data warehouse workload is consistently optimized for performance. For more information, see [Azure Advisor recommendations for dedicated SQL pool in Azure Synapse Analytics](sql-data-warehouse/sql-data-warehouse-concept-recommendations.md).
115+
104116
## Related content
105-
- For a reference of the metrics, logs, and other important values created for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md).
117+
118+
- For information about monitoring in Synapse Studio, see [Monitor your Synapse Workspace](get-started-monitor.md).
119+
- For a comparison of Log Analytics, Query Store, DMVs, and Azure Data Explorer analytics, see [Historical query storage and analysis in Azure Synapse Analytics](sql/query-history-storage-analysis.md).
120+
- For information about Prometheus metrics and Grafana dashboards for Synapse Analytics Apache Spark pools, see [Monitor Apache Spark Applications metrics with Prometheus and Grafana](spark/use-prometheus-grafana-to-monitor-apache-spark-application-level-metrics.md).
121+
- For a reference of the Azure Monitor metrics, logs, and other important values created for Synapse Analytics, see [Synapse Analytics monitoring data reference](monitor-synapse-analytics-reference.md).
106122
- For general details on monitoring Azure resources with Azure Monitor, see [Monitor Azure resources with Azure Monitor](/azure/azure-monitor/essentials/monitor-azure-resource).

0 commit comments

Comments
 (0)