Skip to content

Commit e86f4ac

Browse files
Merge pull request #252125 from ekote/runtimepylibs
Python Env list of Libs per runtime
2 parents 156c551 + feeb728 commit e86f4ac

File tree

3 files changed

+6
-1
lines changed

3 files changed

+6
-1
lines changed

articles/synapse-analytics/spark/apache-spark-32-runtime.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,8 @@ Azure Synapse Analytics supports multiple runtimes for Apache Spark. This docume
3636
| Python | 3.8 |
3737
| R (Preview) | 4.2 |
3838

39+
[Synapse-Python38-CPU.yml](https://github.com/Azure-Samples/Synapse/blob/main/Spark/Python/Synapse-Python38-CPU.yml) contains the list of libraries shipped in the default Python 3.8 environment in Azure Synapse Spark.
40+
3941
## Scala and Java libraries
4042

4143
HikariCP-2.5.1.jar

articles/synapse-analytics/spark/apache-spark-33-runtime.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,9 @@ Azure Synapse Analytics supports multiple runtimes for Apache Spark. This docume
2727
| Python | 3.10 |
2828
| R (Preview) | 4.2.2 |
2929

30+
[Synapse-Python310-CPU.yml](https://github.com/Azure-Samples/Synapse/blob/main/Spark/Python/Synapse-Python310-CPU.yml) contains the list of libraries shipped in the default Python 3.10 environment in Azure Synapse Spark.
31+
32+
3033
>[!IMPORTANT]
3134
> .NET for Apache Spark
3235
> * The [.NET for Apache Spark](https://github.com/dotnet/spark) is an open-source project under the .NET Foundation that currently requires the .NET 3.1 library, which has reached the out-of-support status. We would like to inform users of Azure Synapse Spark of the removal of the .NET for Apache Spark library in the Azure Synapse Runtime for Apache Spark version 3.3. Users may refer to the [.NET Support Policy](https://dotnet.microsoft.com/platform/support/policy/dotnet-core) for more details on this matter.

articles/synapse-analytics/spark/apache-spark-azure-portal-add-libraries.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -75,7 +75,7 @@ To learn more about these capabilities, see [Manage Spark pool packages](./apach
7575
7676
If you're having trouble identifying required dependencies, follow these steps:
7777

78-
1. Run the following script to set up a local Python environment that's the same as the Azure Synapse Spark environment. The script requires [Synapse-Python38-CPU.yml](https://github.com/Azure-Samples/Synapse/blob/main/Spark/Python/Synapse-Python38-CPU.yml), which is the list of libraries shipped in the default Python environment in Azure Synapse Spark.
78+
1. Run the following script to set up a local Python environment that's the same as the Azure Synapse Spark environment. This script requires a YAML file containing a list of all the libraries included in the default Python environment for Azure Synapse Spark. You can find this YAML file in the documentation for specific runtime versions, such as [Apache Spark 3.2 (EOLA)](./apache-spark-32-runtime.md) and [Apache Spark 3.3 (GA)](./apache-spark-33-runtime.md).
7979

8080
```powershell
8181
# One-time Azure Synapse Python setup

0 commit comments

Comments
 (0)