@@ -4,7 +4,7 @@ description: Learn how to use Azure Monitor logs to monitor jobs running in an H
4
4
ms.service : hdinsight
5
5
ms.topic : how-to
6
6
ms.custom : seoapr2020, devx-track-azurepowershell, references_regions, devx-track-azurecli
7
- ms.date : 09/02/2022
7
+ ms.date : 04/14/2023
8
8
---
9
9
10
10
# Use Azure Monitor logs to monitor HDInsight clusters
@@ -141,27 +141,6 @@ Available HDInsight workbooks:
141
141
Screenshot of Spark Workbook
142
142
:::image type="content" source="./media/hdinsight-hadoop-oms-log-analytics-tutorial/hdinsight-spark-workbook.png" alt-text="Spark workbook screenshot":::
143
143
144
- ## Use at-scale Insights to monitor multiple clusters
145
-
146
- You can log into Azure portal and select Monitoring. In the ** Insights** section, you can select ** Insights Hub** . Then you can find HDInsight clusters.
147
-
148
- In this view, you can monitor multiple HDInsight clusters in one place.
149
- :::image type="content" source="./media/hdinsight-hadoop-oms-log-analytics-tutorial/hdinsight-monitor-insights.png" alt-text="Cluster monitor insights screenshot":::
150
-
151
- You can select the subscription and the HDInsight clusters you want to monitor.
152
- - The ** Monitored Clusters** shows the number of clusters you have enabled Azure Monitor integration.
153
- - The ** Unmonitored Cluster** shows the number of clusters you haven't enabled Azure Monitor integration.
154
-
155
- You can see the detail cluster list in each section.
156
-
157
- In the ** Overview** tab under ** Monitored Clusters** , you can see cluster type, critical Alerts, and resource utilizations.
158
- :::image type="content" source="./media/hdinsight-hadoop-oms-log-analytics-tutorial/hdinsight-cluster-alerts.png" alt-text="Cluster monitor alerts screenshot":::
159
-
160
- Also you can see the clusters in each workload type, including Spark, HBase, Hive, and Kafka.
161
-
162
- The high-level metrics of each workload type will be presented, including how many active node managers, how many running applications, etc.
163
-
164
- :::image type="content" source="./media/hdinsight-hadoop-oms-log-analytics-tutorial/spark-metrics.png" alt-text="Cluster monitor spark metrics":::
165
144
166
145
## Configuring performance counters
167
146
@@ -176,7 +155,6 @@ HDInsight support cluster auditing with Azure Monitor logs, by importing the fol
176
155
* ` log_ambari_audit_CL ` - this table provides audit logs from Ambari.
177
156
* ` log_ranger_audti_CL ` - this table provides audit logs from Apache Ranger on ESP clusters.
178
157
179
-
180
158
#### [ Classic Azure Monitor experience] ( #tab/previous )
181
159
182
160
## Prerequisites
0 commit comments