Merge pull request #88453 from dagiro/cats87

cats87

Author: GitHubber17

articles/hdinsight/spark/apache-spark-intellij-tool-plugin.md

@@ -41,8 +41,8 @@ Perform the following steps to install the Scala plugin:
 1. Open IntelliJ IDEA.
 
 2. On the welcome screen, navigate to **Configure** > **Plugins** to open the **Plugins** window.
-   
-    ![Enable scala plugin](./media/apache-spark-intellij-tool-plugin/enable-scala-plugin.png)
+
+    ![Enable scala plugin](./media/apache-spark-intellij-tool-plugin/enable-scala-plugin1.png)
 
 3. Select **Install** for the Scala plugin that is featured in the new window.  
 
@@ -75,7 +75,7 @@ Perform the following steps to install the Scala plugin:
     |Project SDK| This might be blank on your first use of IDEA.  Select **New...** and navigate to your JDK.|
     |Spark Version|The creation wizard integrates the proper version for Spark SDK and Scala SDK. If the Spark cluster version is earlier than 2.0, select **Spark 1.x**. Otherwise, select **Spark2.x**. This example uses **Spark 2.3.0 (Scala 2.11.8)**.|
 
-    ![Selecting the Spark SDK](./media/apache-spark-intellij-tool-plugin/hdi-new-project.png)
+    ![Selecting the Spark SDK](./media/apache-spark-intellij-tool-plugin/intellij-new-project.png)
 
 7. Select **Finish**.  It may take a few minutes before the project becomes available.
 
@@ -87,7 +87,7 @@ Perform the following steps to install the Scala plugin:
 
    c. Select **Cancel**  after viewing the artifact.
 
-      ![Artifact info in the dialog box](./media/apache-spark-intellij-tool-plugin/default-artifact.png)
+      ![Artifact info in the dialog box](./media/apache-spark-intellij-tool-plugin/default-artifact-dialog.png)
 
 9. Add your application source code by doing the following:
 
@@ -129,52 +129,52 @@ User can either [sign in to Azure subscription](#sign-in-to-your-azure-subscript
 ### Sign in to your Azure subscription
 
 1. From the menu bar, navigate to **View** > **Tool Windows** > **Azure Explorer**.
-       
-   ![show azure explorer](./media/apache-spark-intellij-tool-plugin/show-azure-explorer.png)
+
+   ![show azure explorer](./media/apache-spark-intellij-tool-plugin/show-azure-explorer1.png)
 
 2. From Azure Explorer, right-click the **Azure** node, and then select **Sign In**.
-   
+
    ![explorer right-click azure](./media/apache-spark-intellij-tool-plugin/explorer-rightclick-azure.png)
 
 3. In the **Azure Sign In** dialog box, choose **Device Login**, and then select **Sign in**.
 
-    ![view explorer 2](./media/apache-spark-intellij-tool-plugin/view-explorer-2.png)
+    ![view explorer 2](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer2.png)
 
 4. In the **Azure Device Login** dialog box, click **Copy&Open**.
-   
-   ![view explorer 5](./media/apache-spark-intellij-tool-plugin/view-explorer-5.png)
+
+   ![view explorer 5](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer5.png)
 
 5. In the browser interface, paste the code, and then click **Next**.
-   
-   ![view explorer 6](./media/apache-spark-intellij-tool-plugin/view-explorer-6.png)
+
+   ![view explorer 6](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer6.png)
 
 6. Enter your Azure credentials, and then close the browser.
-   
-   ![view explorer 7](./media/apache-spark-intellij-tool-plugin/view-explorer-7.png)
+
+   ![view explorer 7](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer7.png)
 
 7. After you're signed in, the **Select Subscriptions** dialog box lists all the Azure subscriptions that are associated with the credentials. Select your subscription and then select the **Select** button.
 
     ![The Select Subscriptions dialog box](./media/apache-spark-intellij-tool-plugin/Select-Subscriptions.png)
 
 8. From **Azure Explorer**, expand **HDInsight** to view the HDInsight Spark clusters that are in your subscriptions.
 
-    ![view explorer 3](./media/apache-spark-intellij-tool-plugin/view-explorer-3.png)
+    ![view explorer 3](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer3.png)
 
-9.  To view the resources (for example, storage accounts) that are associated with the cluster, you can further expand a cluster-name node.
+9. To view the resources (for example, storage accounts) that are associated with the cluster, you can further expand a cluster-name node.
 
-    ![An expanded cluster-name node](./media/apache-spark-intellij-tool-plugin/view-explorer-4.png)
+    ![An expanded cluster-name node](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer4.png)
 
 ### Link a cluster
 
 You can link an HDInsight cluster by using the Apache Ambari managed username. Similarly, for a domain-joined HDInsight cluster, you can link by using the domain and username, such as `[email protected]`. Also you can link Livy Service cluster.
 
 1. From the menu bar, navigate to **View** > **Tool Windows** > **Azure Explorer**.
 
-2. From Azure Explorer, right-click the **HDInsight** node, and then select **Link A Cluster**.
+1. From Azure Explorer, right-click the **HDInsight** node, and then select **Link A Cluster**.
 
    ![link cluster context menu](./media/apache-spark-intellij-tool-plugin/link-a-cluster-context-menu.png)
 
-3. The available options in the **Link A Cluster** window will vary depending on which value you select from the **Link Resource Type** drop-down list.  Enter your values and then select **OK**.
+1. The available options in the **Link A Cluster** window will vary depending on which value you select from the **Link Resource Type** drop-down list.  Enter your values and then select **OK**.
 
     * **HDInsight Cluster**  
 
@@ -185,7 +185,7 @@ You can link an HDInsight cluster by using the Apache Ambari managed username. S
         |Authentication Type| Leave as **Basic Authentication**|
         |User Name| Enter cluster user name, default is admin.|
         |Password| Enter password for user name.|
-    
+
         ![link HDInsight cluster dialog](./media/apache-spark-intellij-tool-plugin/link-hdinsight-cluster-dialog.png)
 
     * **Livy Service**  
@@ -204,9 +204,9 @@ You can link an HDInsight cluster by using the Apache Ambari managed username. S
 
 1. You can see your linked cluster from the **HDInsight** node.
 
-   ![linked cluster](./media/apache-spark-intellij-tool-plugin/linked-cluster.png)
+   ![linked cluster](./media/apache-spark-intellij-tool-plugin/hdinsight-linked-cluster.png)
 
-2. You also can unlink a cluster from **Azure Explorer**.
+1. You also can unlink a cluster from **Azure Explorer**.
 
    ![unlinked cluster](./media/apache-spark-intellij-tool-plugin/hdi-unlinked-cluster.png)
 
@@ -215,7 +215,7 @@ You can link an HDInsight cluster by using the Apache Ambari managed username. S
 After creating a Scala application, you can submit it to the cluster.
 
 1. From Project, navigate to **myApp** > **src** > **main** > **scala** > **myApp**.  Right-click **myApp**, and select **Submit Spark Application** (It will likely be located at the bottom of the list).
-    
+
       ![The Submit Spark Application to HDInsight command](./media/apache-spark-intellij-tool-plugin/hdi-submit-spark-app-1.png)
 
 2. In the **Submit Spark Application** dialog window, select **1. Spark on HDInsight**.
@@ -239,7 +239,7 @@ After creating a Scala application, you can submit it to the cluster.
     ![The Spark Submission dialog box](./media/apache-spark-intellij-tool-plugin/hdi-submit-spark-app-02.png)
 
 4. Select **SparkJobRun** to submit your project to the selected cluster. The **Remote Spark Job in Cluster** tab displays the job execution progress at the bottom. You can stop the application by clicking the red button. To learn how to access the job output, see the "Access and manage HDInsight Spark clusters by using Azure Toolkit for IntelliJ" section later in this article.  
-      
+
     ![The Spark Submission window](./media/apache-spark-intellij-tool-plugin/hdi-spark-app-result.png)
 
 ## Debug Apache Spark applications locally or remotely on an HDInsight cluster 
@@ -254,19 +254,19 @@ You can perform various operations by using Azure Toolkit for IntelliJ.  Most of
 
 1. From Azure Explorer, navigate to **HDInsight** > \<Your Cluster> > **Jobs**.
 
-    ![Job view node](./media/apache-spark-intellij-tool-plugin/job-view-node.png)
+    ![Job view node](./media/apache-spark-intellij-tool-plugin/intellij-job-view-node.png)
 
 2. In the right pane, the **Spark Job View** tab displays all the applications that were run on the cluster. Select the name of the application for which you want to see more details.
 
-    ![Application details](./media/apache-spark-intellij-tool-plugin/view-job-logs.png)
+    ![Application details](./media/apache-spark-intellij-tool-plugin/intellij-view-job-logs.png)
 
 3. To display basic running job information, hover over the job graph. To view the stages graph and information that every job generates, select a node on the job graph.
 
     ![Job stage details](./media/apache-spark-intellij-tool-plugin/Job-graph-stage-info.png)
 
 4. To view frequently used logs, such as *Driver Stderr*, *Driver Stdout*, and *Directory Info*, select the **Log** tab.
 
-    ![Log details](./media/apache-spark-intellij-tool-plugin/Job-log-info.png)
+    ![Log details](./media/apache-spark-intellij-tool-plugin/intellij-job-log-info.png)
 
 5. You can also view the Spark history UI and the YARN UI (at the application level) by selecting a link at the top of the window.
 
@@ -321,9 +321,9 @@ Ensure you have satisfied the WINUTILS.EXE prerequisite.
 
 7. Then two dialogs may be displayed to ask you if you want to auto fix dependencies. If so, select **Auto Fix**.
 
-    ![Spark Auto Fix1](./media/apache-spark-intellij-tool-plugin/console-auto-fix1.png)
+    ![Spark Auto Fix1](./media/apache-spark-intellij-tool-plugin/intellij-console-autofix1.png)
 
-    ![Spark Auto Fix2](./media/apache-spark-intellij-tool-plugin/console-auto-fix2.png)
+    ![Spark Auto Fix2](./media/apache-spark-intellij-tool-plugin/intellij-console-autofix2.png)
 
 8. The console should look similar to the picture below. In the console window type `sc.appName`, and then press ctrl+Enter.  The result will be shown. You can terminate the local console by clicking red button.
 
@@ -369,50 +369,49 @@ When users submit job to a cluster with reader-only role permission, Ambari cred
 ### Link cluster from context menu
 
 1. Sign in with reader-only role account.
-       
+
 2. From **Azure Explorer**, expand **HDInsight** to view HDInsight clusters that are in your subscription. The clusters marked **"Role:Reader"** only have reader-only role permission.
 
-    ![view explorer 15](./media/apache-spark-intellij-tool-plugin/view-explorer-15.png)
+    ![view explorer 15](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer15.png)
 
 3. Right-click the cluster with reader-only role permission. Select **Link this cluster** from context menu to link cluster. Enter the Ambari username and Password.
 
-  
-    ![view explorer 11](./media/apache-spark-intellij-tool-plugin/view-explorer-11.png)
+    ![view explorer 11](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer11.png)
 
 4. If the cluster is linked successfully, HDInsight will be refreshed.
    The stage of the cluster will become linked.
 
-    ![view explorer 8](./media/apache-spark-intellij-tool-plugin/view-explorer-8.png)
+    ![view explorer 8](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer8.png)
 
 ### Link cluster by expanding Jobs node
 
 1. Click **Jobs** node, **Cluster Job Access Denied** window pops up.
-   
+
 2. Click **Link this cluster** to link cluster.
-   
-    ![view explorer 9](./media/apache-spark-intellij-tool-plugin/view-explorer-9.png)
+
+    ![view explorer 9](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer9.png)
 
 ### Link cluster from Run/Debug Configurations window
 
 1. Create an HDInsight Configuration. Then select **Remotely Run in Cluster**.
-   
+
 2. Select a cluster, which has reader-only role permission for **Spark clusters(Linux only)**. Warning message shows out. You can Click **Link this cluster** to link cluster.
-   
-   ![create config 1](./media/apache-spark-intellij-tool-plugin/create-config-1.png)
-   
+
+   ![create config 1](./media/apache-spark-intellij-tool-plugin/create-configuration.png)
+
 ### View Storage Accounts
 
 * For clusters with reader-only role permission, click **Storage Accounts** node, **Storage Access Denied** window pops up. You can click **Open Azure Storage Explorer** to open Storage Explorer.
-     
-   ![view explorer 14](./media/apache-spark-intellij-tool-plugin/view-explorer-14.png)
 
-   ![view explorer 10](./media/apache-spark-intellij-tool-plugin/view-explorer-10.png)
+   ![view explorer 14](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer14.png)
+
+   ![view explorer 10](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer10.png)
 
 * For linked clusters, click **Storage Accounts** node, **Storage Access Denied** window pops up. You can click **Open Azure Storage** to open Storage Explorer.
-     
-   ![view explorer 13](./media/apache-spark-intellij-tool-plugin/view-explorer-13.png)
 
-   ![view explorer 12](./media/apache-spark-intellij-tool-plugin/view-explorer-12.png)
+   ![view explorer 13](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer13.png)
+
+   ![view explorer 12](./media/apache-spark-intellij-tool-plugin/intellij-view-explorer12.png)
 
 ## Convert existing IntelliJ IDEA applications to use Azure Toolkit for IntelliJ
 
@@ -421,11 +420,11 @@ You can convert the existing Spark Scala applications that you created in Intell
 1. For an existing Spark Scala application that was created through IntelliJ IDEA, open the associated .iml file.
 
 2. At the root level is a **module** element like the following:
-   
+
         <module org.jetbrains.idea.maven.project.MavenProjectsManager.isMavenModule="true" type="JAVA_MODULE" version="4">
 
    Edit the element to add `UniqueKey="HDInsightTool"` so that the **module** element looks like the following:
-   
+
         <module org.jetbrains.idea.maven.project.MavenProjectsManager.isMavenModule="true" type="JAVA_MODULE" version="4" UniqueKey="HDInsightTool">
 
 3. Save the changes. Your application should now be compatible with Azure Toolkit for IntelliJ. You can test it by right-clicking the project name in Project. The pop-up menu now has the option **Submit Spark Application to HDInsight**.