freshness169

Author: dagiro

articles/hdinsight/hadoop/apache-hadoop-use-mapreduce-powershell.md

@@ -2,44 +2,39 @@
 title: Use MapReduce and PowerShell with Apache Hadoop - Azure HDInsight 
 description: Learn how to use PowerShell to remotely run MapReduce jobs with Apache Hadoop on HDInsight.
 author: hrasheed-msft
+ms.author: hrasheed
 ms.reviewer: jasonh
-
 ms.service: hdinsight
-ms.custom: hdinsightactive
 ms.topic: conceptual
-ms.date: 05/09/2018
-ms.author: hrasheed
-
+ms.custom: hdinsightactive
+ms.date: 01/08/2020
 ---
+
 # Run MapReduce jobs with Apache Hadoop on HDInsight using PowerShell
 
 [!INCLUDE [mapreduce-selector](../../../includes/hdinsight-selector-use-mapreduce.md)]
 
 This document provides an example of using Azure PowerShell to run a MapReduce job in a Hadoop on HDInsight cluster.
 
-## <a id="prereq"></a>Prerequisites
-
-[!INCLUDE [updated-for-az](../../../includes/updated-for-az.md)]
+## Prerequisites
 
-* **An Azure HDInsight (Hadoop on HDInsight) cluster**
+* An Apache Hadoop cluster on HDInsight. See [Create Apache Hadoop clusters using the Azure portal](../hdinsight-hadoop-create-linux-clusters-portal.md).
 
-* **A workstation with Azure PowerShell**.
+* The PowerShell [Az Module](https://docs.microsoft.com/powershell/azure/overview) installed.
 
-## <a id="powershell"></a>Run a MapReduce job
+## Run a MapReduce job
 
 Azure PowerShell provides *cmdlets* that allow you to remotely run MapReduce jobs on HDInsight. Internally, PowerShell makes REST calls to [WebHCat](https://cwiki.apache.org/confluence/display/Hive/WebHCat) (formerly called Templeton) running on the HDInsight cluster.
 
 The following cmdlets are used when running MapReduce jobs in a remote HDInsight cluster.
 
-* **Connect-AzAccount**: Authenticates Azure PowerShell to your Azure subscription.
-
-* **New-AzHDInsightMapReduceJobDefinition**: Creates a new *job definition* by using the specified MapReduce information.
-
-* **Start-AzHDInsightJob**: Sends the job definition to HDInsight and starts the job. A *job* object is returned.
-
-* **Wait-AzHDInsightJob**: Uses the job object to check the status of the job. It waits until the job completes or the wait time is exceeded.
-
-* **Get-AzHDInsightJobOutput**: Used to retrieve the output of the job.
+|Cmdlet | Description |
+|---|---|
+|Connect-AzAccount|Authenticates Azure PowerShell to your Azure subscription.|
+|New-AzHDInsightMapReduceJobDefinition|Creates a new *job definition* by using the specified MapReduce information.|
+|Start-AzHDInsightJob|Sends the job definition to HDInsight and starts the job. A *job* object is returned.|
+|Wait-AzHDInsightJob|Uses the job object to check the status of the job. It waits until the job completes or the wait time is exceeded.|
+|Get-AzHDInsightJobOutput|Used to retrieve the output of the job.|
 
 The following steps demonstrate how to use these cmdlets to run a job in your HDInsight cluster.
 
@@ -51,7 +46,7 @@ The following steps demonstrate how to use these cmdlets to run a job in your HD
 
         .\mapreducejob.ps1
 
-    When you run the script, you are prompted for the name of the HDInsight cluster and the cluster login. You may also be prompted to authenticate to your Azure subscription.
+    When you run the script, you're prompted for the name of the HDInsight cluster and the cluster login. You may also be prompted to authenticate to your Azure subscription.
 
 3. When the job completes, you receive output similar to the following text:
 
@@ -79,9 +74,9 @@ To see the words and counts produced by the job, open the **output.txt** file in
 > [!NOTE]  
 > The output files of a MapReduce job are immutable. So if you rerun this sample, you need to change the name of the output file.
 
-## <a id="troubleshooting"></a>Troubleshooting
+## Troubleshooting
 
-If no information is returned when the job completes, view errors for the job. To view error information for this job, add the following command to the end of the **mapreducejob.ps1** file, save it, and then run it again.
+If no information is returned when the job completes, view errors for the job. To view error information for this job, add the following command to the end of the **mapreducejob.ps1** file. Then save the file and rerun the script.
 
 ```powershell
 # Print the output of the WordCount job.
@@ -95,17 +90,9 @@ Get-AzHDInsightJobOutput `
 
 This cmdlet returns the information that was written to STDERR as the job runs.
 
-## <a id="summary"></a>Summary
+## Next steps
 
-As you can see, Azure PowerShell provides an easy way to run MapReduce jobs on an HDInsight cluster, monitor the job status, and retrieve the output.
-
-## <a id="nextsteps"></a>Next steps
-
-For general information about MapReduce jobs in HDInsight:
+As you can see, Azure PowerShell provides an easy way to run MapReduce jobs on an HDInsight cluster, monitor the job status, and retrieve the output. For information about other ways you can work with Hadoop on HDInsight:
 
 * [Use MapReduce on HDInsight Hadoop](hdinsight-use-mapreduce.md)
-
-For information about other ways you can work with Hadoop on HDInsight:
-
 * [Use Apache Hive with Apache Hadoop on HDInsight](hdinsight-use-hive.md)
-* [Use Apache Pig with Apache Hadoop on HDInsight](hdinsight-use-pig.md)