Skip to content

Commit 503b8ea

Browse files
authored
Merge pull request #125597 from changeworld/patch-101
Fix typo
2 parents 9692614 + acc1a82 commit 503b8ea

File tree

1 file changed

+15
-15
lines changed

1 file changed

+15
-15
lines changed

articles/hdinsight/spark/apache-spark-intellij-tool-debug-remotely-through-ssh.md

Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ This article provides step-by-step guidance on how to use HDInsight Tools in [Az
4040
* **Maven** for Scala project-creation wizard support.
4141
* **SBT** for managing the dependencies and building for the Scala project.
4242

43-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-create-projectfor-debug-remotely.png" alt-text="Intellij Create New Project Spark." border="true":::
43+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-create-projectfor-debug-remotely.png" alt-text="IntelliJ Create New Project Spark." border="true":::
4444

4545
1. Select **Next**.
4646

@@ -53,7 +53,7 @@ This article provides step-by-step guidance on how to use HDInsight Tools in [Az
5353
|Project SDK|If blank, select **New...** and navigate to your JDK.|
5454
|Spark Version|The creation wizard integrates the proper version for Spark SDK and Scala SDK. If the Spark cluster version is earlier than 2.0, select **Spark 1.x**. Otherwise, select **Spark 2.x.**. This example uses **Spark 2.3.0 (Scala 2.11.8)**.|
5555

56-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-new-project.png" alt-text="Intellij New Project select Spark version." border="true":::
56+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-new-project.png" alt-text="IntelliJ New Project select Spark version." border="true":::
5757

5858
1. Select **Finish**. It may take a few minutes before the project becomes available. Watch the bottom right-hand corner for progress.
5959

@@ -65,11 +65,11 @@ This article provides step-by-step guidance on how to use HDInsight Tools in [Az
6565

6666
1. Once local run completed, you can see the output file save to your current project explorer **data** > **__default__**.
6767

68-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/spark-local-run-result.png" alt-text="Intellij Project local run result." border="true":::
68+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/spark-local-run-result.png" alt-text="IntelliJ Project local run result." border="true":::
6969

7070
1. Our tools have set the default local run configuration automatically when you perform the local run and local debug. Open the configuration **[Spark on HDInsight] XXX** on the upper right corner, you can see the **[Spark on HDInsight]XXX** already created under **Apache Spark on HDInsight**. Switch to **Locally Run** tab.
7171

72-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/local-run-configuration.png" alt-text="Intellij Run debug configurations local run." border="true":::
72+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/local-run-configuration.png" alt-text="IntelliJ Run debug configurations local run." border="true":::
7373

7474
- [Environment variables](#prerequisites): If you already set the system environment variable **HADOOP_HOME** to **C:\WinUtils**, it can auto detect that no need to manually add.
7575
- [WinUtils.exe Location](#prerequisites): If you have not set the system environment variable, you can find the location by clicking its button.
@@ -89,35 +89,35 @@ This article provides step-by-step guidance on how to use HDInsight Tools in [Az
8989

9090
1. In the **Run/Debug Configurations** dialog box, select the plus sign (**+**). Then select the **Apache Spark on HDInsight** option.
9191

92-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-add-new-Configuration.png" alt-text="Intellij Add new configuration." border="true":::
92+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-add-new-Configuration.png" alt-text="IntelliJ Add new configuration." border="true":::
9393

9494
1. Switch to **Remotely Run in Cluster** tab. Enter information for **Name**, **Spark cluster**, and **Main class name**. Then Click **Advanced configuration (Remote Debugging)**. Our tools support debug with **Executors**. The **numExecutors**, the default value is 5. You'd better not set higher than 3.
9595

96-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-run-debug-configurations.png" alt-text="Intellij Run debug configurations." border="true":::
96+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-run-debug-configurations.png" alt-text="IntelliJ Run debug configurations." border="true":::
9797

9898
1. In the **Advanced Configuration (Remote Debugging)** part, select **Enable Spark remote debug**. Enter the SSH username, and then enter a password or use a private key file. If you want to perform remote debug, you need to set it. There is no need to set it if you just want to use remote run.
9999

100-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-enable-spark-remote-debug.png" alt-text="Intellij Advanced Configuration enable spark remote debug." border="true":::
100+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-enable-spark-remote-debug.png" alt-text="IntelliJ Advanced Configuration enable spark remote debug." border="true":::
101101

102102
1. The configuration is now saved with the name you provided. To view the configuration details, select the configuration name. To make changes, select **Edit Configurations**.
103103

104104
1. After you complete the configurations settings, you can run the project against the remote cluster or perform remote debugging.
105105

106-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/perform-remote-run-button.png" alt-text="Intellij Debug Remote Spark Job Remote run button." border="true":::
106+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/perform-remote-run-button.png" alt-text="IntelliJ Debug Remote Spark Job Remote run button." border="true":::
107107

108108
1. Click the **Disconnect** button that the submission logs not appear in the left panel. However, it is still running on the backend.
109109

110-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/spark-remote-run-result.png" alt-text="Intellij Debug Remote Spark Job Remote run result." border="true":::
110+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/spark-remote-run-result.png" alt-text="IntelliJ Debug Remote Spark Job Remote run result." border="true":::
111111

112112
## Perform remote debugging
113113

114114
1. Set up breaking points, and then Click the **Remote debug** icon. The difference with remote submission is that SSH username/password need to be configured.
115115

116-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-debug-icon.png" alt-text="Intellij Debug Remote Spark Job debug icon." border="true":::
116+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-debug-icon.png" alt-text="IntelliJ Debug Remote Spark Job debug icon." border="true":::
117117

118118
1. When the program execution reaches the breaking point, you see a **Driver** tab and two **Executor** tabs in the **Debugger** pane. Select the **Resume Program** icon to continue running the code, which then reaches the next breakpoint. You need to switch to the correct **Executor** tab to find the target executor to debug. You can view the execution logs on the corresponding **Console** tab.
119119

120-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-debugger-tab.png" alt-text="Intellij Debug Remote Spark Job Debugging tab." border="true":::
120+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-debugger-tab.png" alt-text="IntelliJ Debug Remote Spark Job Debugging tab." border="true":::
121121

122122
### Perform remote debugging and bug fixing
123123

@@ -127,21 +127,21 @@ This article provides step-by-step guidance on how to use HDInsight Tools in [Az
127127

128128
1. Select the **Resume Program** icon to continue. The code stops at the second point. The exception is caught as expected.
129129

130-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-throw-error.png" alt-text="Intellij Debug Remote Spark Job throw error." border="true":::
130+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-throw-error.png" alt-text="IntelliJ Debug Remote Spark Job throw error." border="true":::
131131

132132
1. Select the **Resume Program** icon again. The **HDInsight Spark Submission** window displays a "job run failed" error.
133133

134-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-error-submission.png" alt-text="Intellij Debug Remote Spark Job Error submission." border="true":::
134+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-error-submission.png" alt-text="IntelliJ Debug Remote Spark Job Error submission." border="true":::
135135

136136
1. To dynamically update the variable value by using the IntelliJ debugging capability, select **Debug** again. The **Variables** pane appears again.
137137

138138
1. Right-click the target on the **Debug** tab, and then select **Set Value**. Next, enter a new value for the variable. Then select **Enter** to save the value.
139139

140-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-set-value1.png" alt-text="Intellij Debug Remote Spark Job set value." border="true":::
140+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-set-value1.png" alt-text="IntelliJ Debug Remote Spark Job set value." border="true":::
141141

142142
1. Select the **Resume Program** icon to continue to run the program. This time, no exception is caught. You can see that the project runs successfully without any exceptions.
143143

144-
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-debug-without-exception.png" alt-text="Intellij Debug Remote Spark Job without exception." border="true":::
144+
:::image type="content" source="./media/apache-spark-intellij-tool-debug-remotely-through-ssh/hdinsight-debug-without-exception.png" alt-text="IntelliJ Debug Remote Spark Job without exception." border="true":::
145145

146146
## Next steps
147147

0 commit comments

Comments
 (0)