You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight/selective-logging-analysis.md
+11-11Lines changed: 11 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -52,21 +52,21 @@ For instructions on how to create an HDInsight cluster, see [Get started with Az
52
52
1. For the script type, select **Custom**.
53
53
1. Name the script. For example: **Disable two tables and two sources**.
54
54
1. The Bash script URI must be a link to [selectiveLoggingScript.sh](https://hdiconfigactions.blob.core.windows.net/log-analytics-patch/selectiveLoggingScripts/selectiveLoggingScript.sh).
55
-
1. Select all the node types that apply for the cluster. The options are head node, worker node, and Zookeeper node.
55
+
1. Select all the node types that apply for the cluster. The options are head node, worker node, and ZooKeeper node.
For more details, see the [Parameter syntax](#parameter-syntax) section.
62
+
For more information, see the [Parameter syntax](#parameter-syntax) section.
63
63
64
64
1. Select **Create**.
65
65
1. After a few minutes, a green check mark appears next to your script action history. It means the script has successfully run.
66
66
67
67
:::image type="content" source="./media/hdinsight-hadoop-oms-selective-log-analytics-tutorial/enable-table-and-log-types.png" alt-text="Screenshot that shows a successful run of a script to enable tables and log types.":::
68
68
69
-
You'll see the desired changes in the Log Analytics workspace.
69
+
You'll see your changes in the Log Analytics workspace.
70
70
71
71
## Troubleshooting
72
72
@@ -91,7 +91,7 @@ If you submit your script action but there are no changes in the Log Analytics w
91
91
:::image type="content" source="./media/hdinsight-hadoop-oms-selective-log-analytics-tutorial/background-operations-all.png" alt-text="Screenshot that shows the script run status for hosts.":::
92
92
93
93
1. Check that the parameter syntax from the parameter syntax section is correct.
94
-
1. Check that the Log Analytics workspace is connected to the cluster and Log Analytics monitoring is turned on.
94
+
1. Check that the Log Analytics workspace is connected to the cluster and that Log Analytics monitoring is turned on.
95
95
1. Check that you selected the **Persist this script action to rerun when new nodes are added to the cluster** checkbox for the script action that you ran.
96
96
97
97
:::image type="content" source="./media/hdinsight-hadoop-oms-selective-log-analytics-tutorial/script-action-persists.png" alt-text="Screenshot that shows the checkbox for persisting a script action.":::
@@ -107,7 +107,7 @@ If you submit your script action but there are no changes in the Log Analytics w
107
107
108
108
### The script action failed
109
109
110
-
If the script action shows a **Failed** status in the script action history:
110
+
If the script action shows a failure status in the script action history:
111
111
112
112
1. Check that the parameter syntax from the parameter syntax section is correct.
113
113
1. Check that the script link is correct. It should be: `https://hdiconfigactions.blob.core.windows.net/log-analytics-patch/selectiveLoggingScripts/selectiveLoggingScript.sh`.
@@ -141,7 +141,7 @@ The following table names are for different log types (sources) inside Interacti
141
141
| 5. | HDInsightHiveAndLLAPLogs |**Head node**: InteractiveHiveHSILog, InteractiveHiveMetastoreLog, ZeppelinLog | This table contains logs generated from Hive, LLAP, and their related components: WebHCat and Zeppelin. |
142
142
| 6. | HDInsightHiveAndLLAPmetrics | No log types | This table contains JMX metrics from the Hive and LLAP frameworks. It contains all the same JMX metrics as the old Custom Logs tables. It contains one metric per record. |
143
143
| 7. | HDInsightHiveTezAppStats | No log types |
144
-
| 8. | HDInsightSecurityLogs |**Head node**: AmbariAuditLog, AuthLog **Zookeeper node, worker node**: AuthLog | This table contains records from the Ambari audit and authentication logs. |
144
+
| 8. | HDInsightSecurityLogs |**Head node**: AmbariAuditLog, AuthLog **ZooKeeper node, worker node**: AuthLog | This table contains records from the Ambari audit and authentication logs. |
145
145
146
146
### HBase cluster
147
147
@@ -152,9 +152,9 @@ The following table names are for different log types (sources) inside HBase tab
152
152
| 1. | HDInsightAmbariClusterAlerts | No other log types | This table contains Ambari cluster alerts from each node in the cluster (except for edge nodes). Each alert is a record in this table.
153
153
| 2. | HDInsightAmbariSystem Metrics | No other log types | This table contains system metrics collected from Ambari. The metrics now come from each node in the cluster (except for edge nodes) instead of just the two head nodes. Each metric is now a column, and each metric is reported once per record. |
154
154
| 3. | HDInsightHadoopAndYarnLogs |**Head node**: MRJobSummary, Resource Manager, TimelineServer **Worker node**: NodeManager | This table contains all logs generated from the Hadoop and YARN frameworks. |
155
-
| 4. | HDInsightSecurityLogs |**Head node**: AmbariAuditLog, AuthLog **Worker node**: AuthLog **Zookeeper node**: AuthLog | This table contains records from the Ambari audit and authentication logs. |
156
-
| 5. | HDInsightHBaseLogs |**Head node**: HDFSGarbageCollectorLog, HDFSNameNodeLog **Worker node**: PhoenixServerLog, HBaseRegionServerLog, HBaseRestServerLog **Zookeeper node**: HBaseMasterLog | This table contains logs from HBase and its related components: Phoenix and HDFS. |
157
-
| 6. | HDInsightHBaseMetrics | No log types | This table contains JMX metrics from HBase. It contains all the same JMX metrics from the tables listed in the **Old Schema** column. In contrast from the old tables, each row contains one metric. |
155
+
| 4. | HDInsightSecurityLogs |**Head node**: AmbariAuditLog, AuthLog **Worker node**: AuthLog **ZooKeeper node**: AuthLog | This table contains records from the Ambari audit and authentication logs. |
156
+
| 5. | HDInsightHBaseLogs |**Head node**: HDFSGarbageCollectorLog, HDFSNameNodeLog **Worker node**: PhoenixServerLog, HBaseRegionServerLog, HBaseRestServerLog **ZooKeeper node**: HBaseMasterLog | This table contains logs from HBase and its related components: Phoenix and HDFS. |
157
+
| 6. | HDInsightHBaseMetrics | No log types | This table contains JMX metrics from HBase. It contains all the same JMX metrics from the tables listed in the Old Schema column. In contrast from the old tables, each row contains one metric. |
158
158
| 7. | HDInsightHadoopAndYarn Metrics | No log types | This table contains JMX metrics from the Hadoop and YARN frameworks. It contains all the same JMX metrics as the old Custom Logs tables, plus more metrics that we considered important. We added Timeline Server, Node Manager, and Job History Server metrics. It contains one metric per record. |
159
159
160
160
### Hadoop cluster
@@ -166,10 +166,10 @@ The following table names are for different log types (sources) inside Hadoop ta
166
166
| 1. | HDInsightAmbariClusterAlerts | No log types | This table contains Ambari cluster alerts from each node in the cluster (except for edge nodes). Each alert is a record in this table. |
167
167
| 2. | HDInsightAmbariSystem Metrics | No log types | This table contains system metrics collected from Ambari. The metrics now come from each node in the cluster (except for edge nodes) instead of just the two head nodes. Each metric is now a column, and each metric is reported once per record. |
168
168
| 3. | HDInsightHadoopAndYarnLogs |**Head node**: MRJobSummary, Resource Manager, TimelineServer **Worker node**: NodeManager | This table contains all logs generated from the Hadoop and YARN frameworks. |
169
-
| 4. | HDInsightHadoopAndYarnMetrics | No Log Types| This table contains JMX metrics from the Hadoop and YARN frameworks. It contains all the same JMX metrics as the old Custom Logs tables, plus more metrics that we considered important. We added Timeline Server, Node Manager, and Job History Server metrics. It contains one metric per record. |
169
+
| 4. | HDInsightHadoopAndYarnMetrics | No log types| This table contains JMX metrics from the Hadoop and YARN frameworks. It contains all the same JMX metrics as the old Custom Logs tables, plus more metrics that we considered important. We added Timeline Server, Node Manager, and Job History Server metrics. It contains one metric per record. |
170
170
| 5. | HDInsightHiveAndLLAPLogs |**Head node**: HiveMetastoreLog, HiveServer2Log, WebHcatLog | This table contains logs generated from Hive, LLAP, and their related components: WebHCat and Zeppelin. |
171
171
| 6. | HDInsight Hive And LLAP Metrics | No log types | This table contains JMX metrics from the Hive and LLAP frameworks. It contains all the same JMX metrics as the old Custom Logs tables. It contains one metric per record. |
172
-
| 7. | HDInsight Security Logs |**Head node**: AmbariAuditLog, AuthLog **Zookeeper node**: AuthLog | This table contains records from the Ambari audit and authentication logs. |
172
+
| 7. | HDInsight Security Logs |**Head node**: AmbariAuditLog, AuthLog **ZooKeeper node**: AuthLog | This table contains records from the Ambari audit and authentication logs. |
0 commit comments