You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
description: Tutorial - Use the Azure Toolkit for IntelliJ to develop Spark applications written in Scala, and submit them to an HDInsight Spark cluster.
2
+
title: 'Azure Toolkit for IntelliJ: Spark app - HDInsight'
3
+
description: Use the Azure Toolkit for IntelliJ to develop Spark applications written in Scala, and submit them to an HDInsight Spark cluster.
4
4
author: hrasheed-msft
5
5
ms.author: hrasheed
6
6
ms.reviewer: jasonh
7
7
ms.service: hdinsight
8
8
ms.custom: hdinsightactive
9
-
ms.topic: tutorial
9
+
ms.topic: conceptual
10
10
ms.date: 09/04/2019
11
11
---
12
12
13
-
# Tutorial: Use Azure Toolkit for IntelliJ to create Apache Spark applications for HDInsight cluster
13
+
# Use Azure Toolkit for IntelliJ to create Apache Spark applications for HDInsight cluster
14
14
15
-
This tutorial demonstrates how to develop Apache Spark applications on Azure HDInsight using the **Azure Toolkit** plug-in for the IntelliJ IDE. [Azure HDInsight](../hdinsight-overview.md) is a managed, open-source analytics service in the cloud that allows you to use open-source frameworks like Hadoop, Apache Spark, Apache Hive, and Apache Kafka.
15
+
This article demonstrates how to develop Apache Spark applications on Azure HDInsight using the **Azure Toolkit** plug-in for the IntelliJ IDE. [Azure HDInsight](../hdinsight-overview.md) is a managed, open-source analytics service in the cloud that allows you to use open-source frameworks like Hadoop, Apache Spark, Apache Hive, and Apache Kafka.
16
16
17
17
You can use the **Azure Toolkit** plug-in in a few ways:
18
18
19
19
* Develop and submit a Scala Spark application to an HDInsight Spark cluster.
20
20
* Access your Azure HDInsight Spark cluster resources.
21
21
* Develop and run a Scala Spark application locally.
22
22
23
-
In this tutorial, you learn how to:
23
+
In this article, you learn how to:
24
24
> [!div class="checklist"]
25
25
> * Use the Azure Toolkit for IntelliJ plug-in
26
26
> * Develop Apache Spark applications
@@ -30,7 +30,7 @@ In this tutorial, you learn how to:
30
30
31
31
* An Apache Spark cluster on HDInsight. For instructions, see [Create Apache Spark clusters in Azure HDInsight](apache-spark-jupyter-spark-sql.md).
32
32
33
-
*[Oracle Java Development kit](https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html). This tutorial uses Java version 8.0.202.
33
+
*[Oracle Java Development kit](https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html). This article uses Java version 8.0.202.
34
34
35
35
* IntelliJ IDEA. This article uses [IntelliJ IDEA Community ver. 2018.3.4](https://www.jetbrains.com/idea/download/).
36
36
@@ -72,7 +72,7 @@ Perform the following steps to install the Scala plugin:
72
72
73
73
| Property | Description |
74
74
| ----- | ----- |
75
-
|Project name| Enter a name. This tutorial uses `myApp`.|
75
+
|Project name| Enter a name. This article uses `myApp`.|
76
76
|Project location| Enter the desired location to save your project.|
77
77
|Project SDK| This might be blank on your first use of IDEA. Select **New...** and navigate to your JDK.|
78
78
|Spark Version|The creation wizard integrates the proper version for Spark SDK and Scala SDK. If the Spark cluster version is earlier than 2.0, select **Spark 1.x**. Otherwise, select **Spark2.x**. This example uses **Spark 2.3.0 (Scala 2.11.8)**.|
@@ -467,15 +467,15 @@ If you're not going to continue to use this application, delete the cluster that
467
467
468
468
1. Select **HDInsight clusters** under **Services**.
469
469
470
-
1. In the list of HDInsight clusters that appears, select the **...** next to the cluster that you created for this tutorial.
470
+
1. In the list of HDInsight clusters that appears, select the **...** next to the cluster that you created for this article.
In this tutorial, you learned how to use the Azure Toolkit for IntelliJ plug-in to develop Apache Spark applications written in [Scala](https://www.scala-lang.org/), and then submitted them to an HDInsight Spark cluster directly from the IntelliJ integrated development environment (IDE). Advance to the next article to see how the data you registered in Apache Spark can be pulled into a BI analytics tool such as Power BI.
478
+
In this article, you learned how to use the Azure Toolkit for IntelliJ plug-in to develop Apache Spark applications written in [Scala](https://www.scala-lang.org/), and then submitted them to an HDInsight Spark cluster directly from the IntelliJ integrated development environment (IDE). Advance to the next article to see how the data you registered in Apache Spark can be pulled into a BI analytics tool such as Power BI.
479
479
480
480
> [!div class="nextstepaction"]
481
481
> [Analyze Apache Spark data using Power BI](apache-spark-use-bi-tools.md)
0 commit comments