You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight/spark/spark-best-practices.md
+10-5Lines changed: 10 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,16 +1,17 @@
1
1
---
2
-
title: Apache Spark best practices on Azure HDInsight
3
-
description: Learn best practices for using Apache Spark in Azure HDInsight.
2
+
title: Apache Spark guidelines on Azure HDInsight
3
+
description: Learn guidelines for using Apache Spark in Azure HDInsight.
4
4
author: hrasheed-msft
5
5
ms.author: hrasheed
6
6
ms.reviewer: jasonh
7
7
ms.service: hdinsight
8
8
ms.topic: conceptual
9
-
ms.date: 09/18/2019
9
+
ms.date: 04/28/2020
10
10
---
11
-
# Apache Spark best practices
12
11
13
-
This article provides various best practices for using Apache Spark on Azure HDInsight.
12
+
# Apache Spark guidelines
13
+
14
+
This article provides various guidelines for using Apache Spark on Azure HDInsight.
14
15
15
16
## How do I run or submit Spark jobs?
16
17
@@ -22,6 +23,10 @@ This article provides various best practices for using Apache Spark on Azure HDI
22
23
| IntelliJ |[Tutorial: Create a Scala Maven application for Apache Spark in HDInsight using IntelliJ](./apache-spark-create-standalone-application.md)|
23
24
| Zeppelin notebooks |[Use Apache Zeppelin notebooks with Apache Spark cluster on Azure HDInsight](./apache-spark-zeppelin-notebook.md)|
24
25
| Remote job submission with Livy |[Use Apache Spark REST API to submit remote jobs to an HDInsight Spark cluster](./apache-spark-livy-rest-interface.md)|
26
+
|[Apache Oozie](../hdinsight-use-oozie-linux-mac.md)|Oozie is a workflow and coordination system that manages Hadoop jobs.|
27
+
|[Apache Livy](./apache-spark-livy-rest-interface.md)|You can use Livy to run interactive Spark shells or submit batch jobs to be run on Spark.|
28
+
|[Azure Data Factory for Apache Spark](/../data-factory/transform-data-using-spark.md)|The Spark activity in a Data Factory pipeline executes a Spark program on your own or [on-demand HDInsight cluster.|
29
+
|[Azure Data Factory for Apache Hive](/../data-factory/transform-data-using-hadoop-hive.md)|The HDInsight Hive activity in a Data Factory pipeline executes Hive queries on your own or on-demand HDInsight cluster.|
0 commit comments