Merge pull request #204977 from sreekzz/patch-71

New file Selective-logging-analysis

Author: GitHubber17

articles/hdinsight/TOC.yml

@@ -255,6 +255,8 @@ items:
       items:
       - name: Use Azure Monitor logs
         href: ./hdinsight-hadoop-oms-log-analytics-tutorial.md
+      - name: Use selective logging to monitor logs
+        href: ./selective-logging-analysis.md
       - name: Use queries with Azure Monitor logs
         href: ./hdinsight-hadoop-oms-log-analytics-use-queries.md
       - name: Monitor cluster performance
@@ -417,7 +419,7 @@ items:
           href: ./spark/apache-spark-structured-streaming-overview.md
         - name: Create highly available Apache Spark streaming jobs in Apache Hadoop YARN
           href: ./spark/apache-spark-streaming-high-availability.md
-        - name: Create Apache Spark streaming jobs with exactly-once event processing
+        - name: Create Apache Spark streaming jobs with exactly once event processing
           href: ./spark/apache-spark-streaming-exactly-once.md
       - name: Apache Spark and Machine Learning
         items:
@@ -895,7 +897,7 @@ items:
         href: ./interactive-query/interactive-query-troubleshoot-slow-reducer.md
       - name: Apache Hive gateway timeout
         href: ./interactive-query/troubleshoot-gateway-timeout.md
-      - name: Apache Hive View time out
+      - name: Apache Hive View time-out
         href: ./interactive-query/interactive-query-troubleshoot-view-time-out.md
       - name: Permission error creating table
         href: ./interactive-query/interactive-query-troubleshoot-permission-error-create-table.md
@@ -959,7 +961,7 @@ items:
           href: ./storm/apache-storm-example-topology.md
       - name: Streaming pipelines
         items:
-        - name: Event Hub and Apache Storm (C# & Java)
+        - name: Event Hubs and Apache Storm (C# & Java)
           href: ./storm/apache-storm-develop-csharp-event-hub-topology.md
     - name: Manage
       items:
@@ -1055,3 +1057,4 @@ items:
   items:
   - name: Share Hive metastore with Synapse Spark
     href: share-hive-metastore-with-synapse.md
+    

articles/hdinsight/hdinsight-hadoop-oms-log-analytics-tutorial.md

@@ -4,7 +4,7 @@ description: Learn how to use Azure Monitor logs to monitor jobs running in an H
 ms.service: hdinsight
 ms.topic: how-to
 ms.custom: seoapr2020, devx-track-azurepowershell, references_regions, devx-track-azurecli
-ms.date: 09/21/2021
+ms.date: 08/01/2021
 ---
 
 # Use Azure Monitor logs to monitor HDInsight clusters
@@ -285,7 +285,7 @@ az hdinsight monitor disable --name $cluster --resource-group $resourceGroup
 ```
 ## <a name="oms-with-firewall"></a>Prerequisites for clusters behind a firewall
 
-To be able to successfully setup Azure Monitor integration with HDInsight, behind a firewall, some customers may need to enable the following endpoints:
+To be able to successfully set up Azure Monitor integration with HDInsight, behind a firewall, some customers may need to enable the following endpoints:
 
 |Agent Resource | Ports | Direction | Bypass HTTPS inspection |
 |---|---|---|---|
@@ -305,7 +305,7 @@ Once the setup is successful, enabling necessary endpoints for data ingestion is
 
 ## Install HDInsight cluster management solutions
 
-HDInsight provides cluster-specific management solutions that you can add for Azure Monitor logs. [Management solutions](../azure-monitor/insights/solutions.md) add functionality to Azure Monitor logs, providing more data and analysis tools. These solutions collect important performance metrics from your HDInsight clusters. And provide the tools to search the metrics. These solutions also provide visualizations and dashboards for most cluster types supported in HDInsight. By using the metrics that you collect with the solution, you can create custom monitoring rules and alerts.
+HDInsight provides cluster-specific management solutions that you can add for Azure Monitor Logs. [Management solutions](../azure-monitor/insights/solutions.md) add functionality to Azure Monitor Logs, providing more data and analysis tools. These solutions collect important performance metrics from your HDInsight clusters. And provide the tools to search the metrics. These solutions also provide visualizations and dashboards for most cluster types supported in HDInsight. By using the metrics that you collect with the solution, you can create custom monitoring rules and alerts.
 
 Available HDInsight solutions:
 
@@ -354,6 +354,6 @@ If you have Azure Monitor Integration enabled on a cluster, updating the OMS age
 ```
 
 ## Next steps
-
+* [Selective logging analysis](selective-logging-analysis.md)
 * [Query Azure Monitor logs to monitor HDInsight clusters](hdinsight-hadoop-oms-log-analytics-use-queries.md)
 * [How to monitor cluster availability with Apache Ambari and Azure Monitor logs](./hdinsight-cluster-availability.md)

articles/hdinsight/log-analytics-migration.md

@@ -33,7 +33,7 @@ Considering customer feedback, the Azure HDInsight team invested in integration
 
 
 > [!NOTE]  
-> New Azure Montitor integration is in Public Preview. It is only available in East US and West Europe regions.
+> New Azure Montitor integration is in Public Preview across all regions where HDInsight is available.
 
 
 ## Benefits of the new Azure Monitor integration
@@ -42,7 +42,7 @@ This document outlines the changes to the Azure Monitor integration and provides
 
 **Redesigned schemas**: The schema formatting for the new Azure Monitor integration is better organized and easy to understand. There are two-thirds fewer schemas to remove as much ambiguity in the legacy schemas as possible.
 
-**Selective Logging (releasing soon)**: There are logs and metrics available through Log Analytics. To help you save on monitoring costs, we'll be releasing a new selective logging feature. Use this feature to turn on and off different logs and metric sources. With this feature, you'll only have to pay for what you use.
+**Selective Logging**: There are logs and metrics available through Log Analytics. To help you save on monitoring costs, we'll be releasing a new selective logging feature. Use this feature to turn on and off different logs and metric sources. With this feature, you'll only have to pay for what you use. For more details see [Selective Logging](selective-logging-analysis.md)
 
 **Logs cluster portal integration**: The **Logs** pane is new to the HDInsight Cluster portal. Anyone with access to the cluster can go to this pane to query any table that the cluster resource sends records to. Users don't need access to the Log Analytics workspace anymore to see the records for a specific cluster resource.