Skip to content

Commit 73e0000

Browse files
authored
Merge pull request #189439 from v-lanjli/lanbranch_docforvscode/main
update synapse interactive for vscode
2 parents bc790cc + 53d8432 commit 73e0000

File tree

4 files changed

+23
-17
lines changed

4 files changed

+23
-17
lines changed

articles/hdinsight/hdinsight-for-vscode.md

Lines changed: 7 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -164,7 +164,7 @@ With Spark & Hive Tools for Visual Studio Code, you can submit interactive Hive
164164

165165
- **MESSAGES** panel: When you select a **Line** number, it jumps to the first line of the running script.
166166

167-
## Submit interactive PySpark queries
167+
## Submit interactive PySpark queries (Not supported Synapse PySpark interactive anymore)
168168

169169
Users can perform PySpark interactive in the following ways:
170170

@@ -260,7 +260,8 @@ The tool also supports the **Spark SQL** query:
260260

261261
> [!NOTE]
262262
>
263-
> [ms-toolsai.jupyter >2021.3.684299474 version is not supported on this extension](#known-issues) is a known issue. Please using Synapse kernel by sticking to Microsoft Jupyter 2021.3.684299474.
263+
> [For Synapse PySpark installation error](#known-issues), since its dependency will not be maintained anymore by other team, this will not be maintained anymore as well. If you trying to use Synapse Pyspark interactive, please switch to use [Azure Synapse Analytics](https://ms.web.azuresynapse.net/en-us/) instead. And it's a long term change.
264+
>
264265
265266
## Submit PySpark batch job
266267

@@ -311,7 +312,7 @@ You can follow the normal steps to sign in to Azure subscription to connect to y
311312

312313
For run a hive job, you can follow the normal steps to submit job to HDInsight ESP cluster with ID Broker (HIB). Refer to [Submit interactive Hive queries and Hive batch scripts](#submit-interactive-hive-queries-and-hive-batch-scripts) for more instructions.
313314

314-
For run a interactive PySpark job, you can follow the normal steps to submit job to HDInsight ESP cluster with ID Broker (HIB). Refer to [Submit interactive PySpark queries](#submit-interactive-pyspark-queries) for more instructions.
315+
For run an interactive PySpark job, you can follow the normal steps to submit job to HDInsight ESP cluster with ID Broker (HIB). Refer to Submit interactive PySpark queries.
315316

316317
For run a PySpark batch job, you can follow the normal steps to submit job to HDInsight ESP cluster with ID Broker (HIB). Refer to [Submit PySpark batch job](#submit-pyspark-batch-job) for more instructions.
317318

@@ -483,17 +484,11 @@ From the menu bar, go to **View** > **Command Palette**, and then enter **Azure:
483484

484485
## Known Issues
485486

486-
ms-toolsai.jupyter >2021.3.684299474 version is not supported on this extension, please using Synapse kernel by sticking to Microsoft Jupyter 2021.3.684299474.
487-
488-
1. Disable auto updating extension.
489-
490-
![disable auto updating extension](./media/hdinsight-for-vscode/disable-auto-updating-extension.png)
491-
492-
2. Install a selected version of Microsoft Jupyter.
487+
### Synapse PySpark installation error.
493488

494-
![selected version of microsoft jupyter](./media/hdinsight-for-vscode/selected-version-of-microsoft-jupyter.png)
489+
For Synapse PySpark installation error, since its dependency will not be maintained anymore by other team, it will not be maintained anymore. If you trying to use Synapse Pyspark interactive, please use [Azure Synapse Analytics](https://ms.web.azuresynapse.net/) instead. And it's a long term change.
495490

496-
3. Install Microsoft Jupyter version 2021.3.684299474
491+
![synapse pyspark installation error](./media/hdinsight-for-vscode/known-issue.png)
497492

498493

499494
## Next steps
-1.47 KB
Loading
-1.47 KB
Loading

articles/synapse-analytics/spark/vscode-tool-synapse.md

Lines changed: 16 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ ms.subservice: spark
1111
ms.date: 09/03/2020
1212
---
1313

14-
# Tutorial: Create an Apache Spark applications with VSCode using a Synapse workspace
14+
# Tutorial: Create an Apache Spark application with VSCode using a Synapse workspace
1515

1616
Learn how to use Apache Spark & Hive Tools for Visual Studio Code. Use the tools to create and submit Apache Hive batch jobs, interactive Hive queries, and PySpark scripts for Apache Spark. First we'll describe how to install Spark & Hive Tools in Visual Studio Code. Then we'll walk through how to submit jobs to Spark & Hive Tools.
1717

@@ -29,6 +29,7 @@ The following items are required for completing the steps in this article:
2929

3030
## Install Spark & Hive Tools
3131

32+
3233
After you meet the prerequisites, you can install Spark & Hive Tools for Visual Studio Code by following these steps:
3334

3435
1. Open Visual Studio Code.
@@ -43,6 +44,10 @@ After you meet the prerequisites, you can install Spark & Hive Tools for Visual
4344

4445
5. Select **Reload** when necessary.
4546

47+
> [!Note]
48+
>
49+
> **Synapse PySpark installation error** is an [known issue](#known-issues).
50+
4651
## Open a work folder
4752

4853
To open a work folder and to create a file in Visual Studio Code, follow these steps:
@@ -85,7 +90,12 @@ Follow these steps to connect to Azure:
8590

8691
![Set default cluster configuration](./media/vscode-tool-synapse/set-default-cluster-configuration.png)
8792

88-
## Submit interactive Synapse PySpark queries to Spark pool
93+
## Submit interactive Synapse PySpark queries to Spark pool (Not supported anymore)
94+
95+
> [!NOTE]
96+
>
97+
>For Synapse Pyspark interactive, since its dependency will not be maintained anymore by other team, this will not be maintained anymore as well. If you trying to use Synapse Pyspark interactive, please switch to use [Azure Synapse Analytics](https://ms.web.azuresynapse.net/en-us/) instead. And it's a long term change.
98+
>
8999
90100
Users can perform Synapse PySpark interactive on Spark pool in the following ways:
91101

@@ -291,12 +301,13 @@ You can perform different operations in Azure Explorer within Spark & Hive tools
291301

292302
## Known issues
293303

294-
### ms-python >=2020.5.78807 version is not supported on this extention
295-
296-
"Failed to connect to Jupyter notebook." is a known issue for python version >=2020.5.78807. It is recommended that users use the **[2020.4.76186](https://github.com/microsoft/vscode-python/releases/download/2020.4.76186/ms-python-release.vsix)** version of ms-python to avoid this issue.
304+
### Synapse PySpark installation error.
297305

298306
![known issues](./media/vscode-tool-synapse/known-issue.png)
299307

308+
### Not supported submit interactive Synapse PySpark queries to Spark pool anymore
309+
310+
For Synapse Pyspark interactive, since its dependency will not be maintained anymore by other team, this will not be maintained anymore as well. If you trying to use Synapse Pyspark interactive, please switch to use [Azure Synapse Analytics](https://ms.web.azuresynapse.net/en-us/) instead. And it's a long term change.
300311

301312
## Next steps
302313

0 commit comments

Comments
 (0)