Skip to content

Commit 3754533

Browse files
authored
Merge pull request #88400 from dagiro/cats83
cats83
2 parents b432595 + d656fcb commit 3754533

File tree

10 files changed

+8
-8
lines changed

10 files changed

+8
-8
lines changed

articles/hdinsight/spark/apache-spark-connect-to-sql-database.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -177,7 +177,7 @@ In this section, we stream data into the **hvactable** that you already created
177177

178178
1. The output shows the schema of **HVAC.csv**. The **hvactable** has the same schema as well. The output lists the columns in the table.
179179

180-
![Schema of table](./media/apache-spark-connect-to-sql-database/schema-of-table.png "Schema of table")
180+
![Schema of table](./media/apache-spark-connect-to-sql-database/hdinsight-schema-table.png "Schema of table")
181181

182182
1. Finally, use the following snippet to read data from the HVAC.csv and stream it into the **hvactable** in Azure SQL database. Paste the snippet in a code cell, replace the placeholder values with the values for your Azure SQL database, and then press **SHIFT + ENTER** to run.
183183

articles/hdinsight/spark/apache-spark-create-standalone-application.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -46,7 +46,7 @@ Perform the following steps to install the Scala plugin:
4646

4747
2. On the welcome screen, navigate to **Configure** > **Plugins** to open the **Plugins** window.
4848

49-
![Enable scala plugin](./media/apache-spark-create-standalone-application/enable-scala-plugin.png)
49+
![Enable scala plugin](./media/apache-spark-create-standalone-application/enable-scala-plugin1.png)
5050

5151
3. Select **Install** for the Scala plugin that is featured in the new window.
5252

@@ -79,7 +79,7 @@ Perform the following steps to install the Scala plugin:
7979
|Project SDK| This will be blank on your first use of IDEA. Select **New...** and navigate to your JDK.|
8080
|Spark Version|The creation wizard integrates the proper version for Spark SDK and Scala SDK. If the Spark cluster version is earlier than 2.0, select **Spark 1.x**. Otherwise, select **Spark2.x**. This example uses **Spark 2.3.0 (Scala 2.11.8)**.|
8181

82-
![Selecting the Spark SDK](./media/apache-spark-create-standalone-application/hdi-new-project.png)
82+
![Selecting the Spark SDK](./media/apache-spark-create-standalone-application/hdi-scala-new-project.png)
8383

8484
7. Select **Finish**.
8585

@@ -122,7 +122,7 @@ Perform the following steps to install the Scala plugin:
122122

123123
16. Select **Apply**, and then select **OK**. You will then be returned to the project window.
124124

125-
![Configure Maven for automatic downloads](./media/apache-spark-create-standalone-application/configure-maven.png)
125+
![Configure Maven for automatic downloads](./media/apache-spark-create-standalone-application/configure-maven-download.png)
126126

127127

128128
17. From the left pane, navigate to **src** > **main** > **scala** > **com.microsoft.spark.example**, and then double-click **App** to open App.scala.
@@ -174,21 +174,21 @@ Perform the following steps to install the Scala plugin:
174174

175175
2. From the **Project Structure** window, navigate to **Artifacts** > **the plus symbol +** > **JAR** > **From modules with dependencies...**.
176176

177-
![Create JAR1](./media/apache-spark-create-standalone-application/create-jar-1.png)
177+
![Create JAR1](./media/apache-spark-create-standalone-application/hdinsight-create-jar1.png)
178178

179179
3. In the **Create JAR from Modules** window, select the folder icon in the **Main Class** text box.
180180

181181
4. In the **Select Main Class** window, select the class that appears by default and then select **OK**.
182182

183-
![Create JAR2](./media/apache-spark-create-standalone-application/create-jar-2.png)
183+
![Create JAR2](./media/apache-spark-create-standalone-application/hdinsight-create-jar2.png)
184184

185185
5. In the **Create JAR from Modules** window, ensure the **extract to the target JAR** option is selected, and then select **OK**. This setting creates a single JAR with all dependencies.
186186

187-
![Create JAR3](./media/apache-spark-create-standalone-application/create-jar-3.png)
187+
![Create JAR3](./media/apache-spark-create-standalone-application/hdinsight-create-jar3.png)
188188

189189
6. The **Output Layout** tab lists all the jars that are included as part of the Maven project. You can select and delete the ones on which the Scala application has no direct dependency. For the application, you are creating here, you can remove all but the last one (**SparkSimpleApp compile output**). Select the jars to delete and then select the negative symbol **-**.
190190

191-
![Create JAR4](./media/apache-spark-create-standalone-application/delete-output-jars.png)
191+
![Create JAR4](./media/apache-spark-create-standalone-application/hdi-delete-output-jars.png)
192192

193193
Ensure sure the **Include in project build** checkbox is selected, which ensures that the jar is created every time the project is built or updated. Select **Apply** and then **OK**.
194194

0 commit comments

Comments
 (0)