You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Users can perform PySpark interactive in the following ways:
170
170
@@ -260,7 +260,8 @@ The tool also supports the **Spark SQL** query:
260
260
261
261
> [!NOTE]
262
262
>
263
-
> [ms-toolsai.jupyter >2021.3.684299474 version is not supported on this extension](#known-issues) is a known issue. Please using Synapse kernel by sticking to Microsoft Jupyter 2021.3.684299474.
263
+
> [For Synapse PySpark installation error](#known-issues), since its dependency will not be maintained anymore by other team, this will not be maintained anymore as well. If you trying to use Synapse Pyspark interactive, please switch to use [Azure Synapse Analytics](https://ms.web.azuresynapse.net/en-us/) instead. And it's a long term change.
264
+
>
264
265
265
266
## Submit PySpark batch job
266
267
@@ -311,7 +312,7 @@ You can follow the normal steps to sign in to Azure subscription to connect to y
311
312
312
313
For run a hive job, you can follow the normal steps to submit job to HDInsight ESP cluster with ID Broker (HIB). Refer to [Submit interactive Hive queries and Hive batch scripts](#submit-interactive-hive-queries-and-hive-batch-scripts) for more instructions.
313
314
314
-
For run a interactive PySpark job, you can follow the normal steps to submit job to HDInsight ESP cluster with ID Broker (HIB). Refer to [Submit interactive PySpark queries](#submit-interactive-pyspark-queries) for more instructions.
315
+
For run an interactive PySpark job, you can follow the normal steps to submit job to HDInsight ESP cluster with ID Broker (HIB). Refer to Submit interactive PySpark queries.
315
316
316
317
For run a PySpark batch job, you can follow the normal steps to submit job to HDInsight ESP cluster with ID Broker (HIB). Refer to [Submit PySpark batch job](#submit-pyspark-batch-job) for more instructions.
317
318
@@ -483,17 +484,11 @@ From the menu bar, go to **View** > **Command Palette**, and then enter **Azure:
483
484
484
485
## Known Issues
485
486
486
-
ms-toolsai.jupyter >2021.3.684299474 version is not supported on this extension, please using Synapse kernel by sticking to Microsoft Jupyter 2021.3.684299474.
487
-
488
-
1. Disable auto updating extension.
489
-
490
-

491
-
492
-
2. Install a selected version of Microsoft Jupyter.
487
+
### Synapse PySpark installation error.
493
488
494
-

489
+
For Synapse PySpark installation error, since its dependency will not be maintained anymore by other team, it will not be maintained anymore. If you trying to use Synapse Pyspark interactive, please use [Azure Synapse Analytics](https://ms.web.azuresynapse.net/) instead. And it's a long term change.
495
490
496
-
3. Install Microsoft Jupyter version 2021.3.684299474
Copy file name to clipboardExpand all lines: articles/synapse-analytics/spark/vscode-tool-synapse.md
+16-5Lines changed: 16 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,7 +11,7 @@ ms.subservice: spark
11
11
ms.date: 09/03/2020
12
12
---
13
13
14
-
# Tutorial: Create an Apache Spark applications with VSCode using a Synapse workspace
14
+
# Tutorial: Create an Apache Spark application with VSCode using a Synapse workspace
15
15
16
16
Learn how to use Apache Spark & Hive Tools for Visual Studio Code. Use the tools to create and submit Apache Hive batch jobs, interactive Hive queries, and PySpark scripts for Apache Spark. First we'll describe how to install Spark & Hive Tools in Visual Studio Code. Then we'll walk through how to submit jobs to Spark & Hive Tools.
17
17
@@ -29,6 +29,7 @@ The following items are required for completing the steps in this article:
29
29
30
30
## Install Spark & Hive Tools
31
31
32
+
32
33
After you meet the prerequisites, you can install Spark & Hive Tools for Visual Studio Code by following these steps:
33
34
34
35
1. Open Visual Studio Code.
@@ -43,6 +44,10 @@ After you meet the prerequisites, you can install Spark & Hive Tools for Visual
43
44
44
45
5. Select **Reload** when necessary.
45
46
47
+
> [!Note]
48
+
>
49
+
> **Synapse PySpark installation error** is an [known issue](#known-issues).
50
+
46
51
## Open a work folder
47
52
48
53
To open a work folder and to create a file in Visual Studio Code, follow these steps:
@@ -85,7 +90,12 @@ Follow these steps to connect to Azure:
## Submit interactive Synapse PySpark queries to Spark pool
93
+
## Submit interactive Synapse PySpark queries to Spark pool (Not supported anymore)
94
+
95
+
> [!NOTE]
96
+
>
97
+
>For Synapse Pyspark interactive, since its dependency will not be maintained anymore by other team, this will not be maintained anymore as well. If you trying to use Synapse Pyspark interactive, please switch to use [Azure Synapse Analytics](https://ms.web.azuresynapse.net/en-us/) instead. And it's a long term change.
98
+
>
89
99
90
100
Users can perform Synapse PySpark interactive on Spark pool in the following ways:
91
101
@@ -291,12 +301,13 @@ You can perform different operations in Azure Explorer within Spark & Hive tools
291
301
292
302
## Known issues
293
303
294
-
### ms-python >=2020.5.78807 version is not supported on this extention
295
-
296
-
"Failed to connect to Jupyter notebook."is a known issue for python version >=2020.5.78807. It is recommended that users use the **[2020.4.76186](https://github.com/microsoft/vscode-python/releases/download/2020.4.76186/ms-python-release.vsix)** version of ms-python to avoid this issue.
### Not supported submit interactive Synapse PySpark queries to Spark pool anymore
309
+
310
+
For Synapse Pyspark interactive, since its dependency will not be maintained anymore by other team, this will not be maintained anymore as well. If you trying to use Synapse Pyspark interactive, please switch to use [Azure Synapse Analytics](https://ms.web.azuresynapse.net/en-us/) instead. And it's a long term change.
0 commit comments