Skip to content

Commit 4ca1d04

Browse files
Addressed review comments
Added the external link to spark-submit in the Next Steps.
1 parent 0531f22 commit 4ca1d04

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

articles/hdinsight/interactive-query/apache-hive-warehouse-connector.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -153,7 +153,8 @@ This is a way to run Spark interactively through a modified version of the Scala
153153
154154
### Spark-submit
155155
156-
Spark-submit is a utility to submit any spark program (or job) to Spark clusters.
156+
Spark-submit is a utility to submit any Spark program (or job) to Spark clusters.
157+
157158
The spark-submit job will setup and configure Spark and Hive Warehouse Connector as per our instructions, execute the program we pass to it, then cleanly release the resources that were being used.
158159
159160
Once you build the scala/java code along with the dependencies into an assembly jar, use the below command to launch a Spark application. Replace `<VERSION>`, and `<APP_JAR_PATH>` with the actual values.
@@ -182,7 +183,8 @@ Once you build the scala/java code along with the dependencies into an assembly
182183
```
183184
184185
This utility is also used when we have written the entire application in pySpark and packaged into py files (Python), so that we can submit the entire code to Spark cluster for execution.
185-
For Python applications, simply pass a .py file in the place of /<APP_JAR_PATH>/myHwcAppProject.jar, and add the below configuration (Python .zip) file to the search path with --py-files.
186+
187+
For Python applications, simply pass a .py file in the place of `/<APP_JAR_PATH>/myHwcAppProject.jar`, and add the below configuration (Python .zip) file to the search path with `--py-files`.
186188
187189
```python
188190
--py-files /usr/hdp/current/hive_warehouse_connector/pyspark_hwc-<VERSION>.zip
@@ -235,3 +237,4 @@ kinit USERNAME
235237
* [Use Interactive Query with HDInsight](./apache-interactive-query-get-started.md)
236238
* [HWC integration with Apache Zeppelin](./apache-hive-warehouse-connector-zeppelin.md)
237239
* [Examples of interacting with Hive Warehouse Connector using Zeppelin, Livy, spark-submit, and pyspark](https://community.hortonworks.com/articles/223626/integrating-apache-hive-with-apache-spark-hive-war.html)
240+
* [Submitting Spark Applications via Spark-submit utility](https://spark.apache.org/docs/2.4.0/submitting-applications.html)

0 commit comments

Comments
 (0)