You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
# Azure Synapse Runtime for Apache Spark 3.1 (EOLA)
14
14
15
-
Azure Synapse Analytics supports multiple runtimes for Apache Spark. This document will cover the runtime components and versions for the Azure Synapse Runtime for Apache Spark 3.1.
15
+
Azure Synapse Analytics supports multiple runtimes for Apache Spark. This document covers the runtime components and versions for the Azure Synapse Runtime for Apache Spark 3.1.
16
16
17
17
> [!IMPORTANT]
18
18
> * End of life announced (EOLA) for Azure Synapse Runtime for Apache Spark 3.1 has been announced January 26, 2023.
@@ -733,7 +733,7 @@ abseil-cpp=20210324.0
733
733
734
734
absl-py=0.13.0
735
735
736
-
adal=1.2.7
736
+
Microsoft Authentication Library=1.2.7
737
737
738
738
adlfs=0.7.7
739
739
@@ -817,7 +817,7 @@ chardet=4.0.0
817
817
818
818
charls=2.2.0
819
819
820
-
click=8.0.1
820
+
Select=8.0.1
821
821
822
822
cloudpickle=1.6.0
823
823
@@ -1741,7 +1741,7 @@ httr 1.4.3
1741
1741
1742
1742
hwriter 1.3.2.1
1743
1743
1744
-
ids 1.0.1
1744
+
IDs 1.0.1
1745
1745
1746
1746
ini 0.3.1
1747
1747
@@ -2043,4 +2043,4 @@ zoo 1.8-10
2043
2043
2044
2044
## Migration between Apache Spark versions - support
2045
2045
2046
-
For guidance on migrating from older runtime versions to Azure Synapse Runtime for Apache Spark 3.3 or 3.4 refer to [Runtime for Apache Spark Overview](./apache-spark-version-support.md).
2046
+
For guidance on migrating from older runtime versions to Azure Synapse Runtime for Apache Spark 3.3 or 3.4, refer to [Runtime for Apache Spark Overview](./apache-spark-version-support.md).
Copy file name to clipboardExpand all lines: articles/synapse-analytics/spark/apache-spark-34-runtime.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -24,15 +24,14 @@ Azure Synapse Analytics supports multiple runtimes for Apache Spark. This docume
24
24
| Python | 3.10 |
25
25
| R | 4.2.2 |
26
26
27
-
28
-
29
-
As of now, creation of Spark 3.4 pools will be available only thru Azure Synapse Studio. In the upcoming weeks we will add the Azure Portal and ARM support.
30
-
27
+
As of now, creation of Spark 3.4 pools are available only through Azure Synapse Studio. In the upcoming weeks we'll add the Azure portal and ARM support.
31
28
32
29
## Libraries
30
+
33
31
The following sections present the libraries included in Azure Synapse Runtime for Apache Spark 3.4 (Public Preview).
34
32
35
33
### Scala and Java default libraries
34
+
36
35
The following table lists all the default level packages for Java/Scala and their respective versions.
37
36
38
37
| GroupID | ArtifactID | Version |
@@ -338,8 +337,9 @@ The following table lists all the default level packages for Java/Scala and thei
338
337
| pl.edu.icm | JLargeArrays | 1.5 |
339
338
| stax | stax-api | 1.0.1 |
340
339
341
-
### Python libraries
342
-
The Azure Synapse Runtime for Apache Spark 3.4 is currently in Public Preview. During this phase, the Python libraries will experience significant updates. Additionally, please note that some machine learning capabilities are not yet supported, such as the PREDICT method and Synapse ML.
340
+
### Python libraries
341
+
342
+
The Azure Synapse Runtime for Apache Spark 3.4 is currently in Public Preview. During this phase, the Python libraries experience significant updates. Additionally, please note that some machine learning capabilities aren't yet supported, such as the PREDICT method and Synapse ML.
343
343
344
344
### R libraries
345
345
@@ -478,7 +478,7 @@ The following table lists all the default level packages for R and their respect
478
478
479
479
## Migration between Apache Spark versions - support
480
480
481
-
For guidance on migrating from older runtime versions to Azure Synapse Runtime for Apache Spark 3.4 refer to [Runtime for Apache Spark Overview](./apache-spark-version-support.md).
481
+
For guidance on migrating from older runtime versions to Azure Synapse Runtime for Apache Spark 3.4, refer to [Runtime for Apache Spark Overview](./apache-spark-version-support.md).
0 commit comments