You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/synapse-analytics/spark/apache-spark-version-support.md
+2-10Lines changed: 2 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,29 +15,21 @@ ms.custom: devx-track-python
15
15
Apache Spark pools in Azure Synapse use runtimes to tie together essential component versions such as Azure Synapse optimizations, packages, and connectors with a specific Apache Spark version. Each runtime is upgraded periodically to include new improvements, features, and patches. When you create a serverless Apache Spark pool, select the corresponding Apache Spark version. Based on this, the pool comes preinstalled with the associated runtime components and packages.
16
16
17
17
The runtimes have the following advantages:
18
-
19
18
- Faster session startup times
20
19
- Tested compatibility with specific Apache Spark versions
21
20
- Access to popular, compatible connectors and open-source packages
22
21
23
22
## Supported Azure Synapse runtime releases
24
23
25
-
> [!WARNING]
26
-
> End of Support Notification for Azure Synapse Runtime for Apache Spark 2.4, Apache Spark 3.1 and Apache Spark 3.2.
27
-
> * Effective September 29, 2023, Azure Synapse will discontinue official support for Spark 2.4 Runtimes.
28
-
> * Effective January 26, 2024, Azure Synapse will discontinue official support for Spark 3.1 Runtimes.
29
-
> * Effective July 8, 2024, Azure Synapse will discontinue official support for Spark 3.2 Runtimes.
30
-
> * After these dates, we will not be addressing any support tickets related to Spark 2.4, 3.1 and 3.2. There will be no release pipeline in place for bug or security fixes for Spark 2.4, 3.1 and 3.2. **Utilizing Spark 2.4, 3.1 and 3.2 post the support cutoff dates is undertaken at one's own risk. We strongly discourage its continued use due to potential security and functionality concerns.**
31
-
32
24
> [!TIP]
33
-
> We strongly recommend proactively upgrading workloads to a more recent GA version of the runtime (for example,[Azure Synapse Runtime for Apache Spark 3.4 (GA)](./apache-spark-34-runtime.md)). Refer to the [Apache Spark migration guide](https://spark.apache.org/docs/latest/sql-migration-guide.html).
25
+
> We strongly recommend proactively upgrading workloads to a more recent GA version of the runtime which is[Azure Synapse Runtime for Apache Spark 3.4 (GA)](./apache-spark-34-runtime.md)). Refer to the [Apache Spark migration guide](https://spark.apache.org/docs/latest/sql-migration-guide.html).
34
26
35
27
The following table lists the runtime name, Apache Spark version, and release date for supported Azure Synapse Runtime releases.
36
28
37
29
| Runtime name | Release date | Release stage | End of Support announcement date | End of Support effective date |
|[Azure Synapse Runtime for Apache Spark 3.4](./apache-spark-34-runtime.md)| Nov 21, 2023 | GA (as of Apr 8, 2024) | Q2 2025| Q1 2026|
40
-
|[Azure Synapse Runtime for Apache Spark 3.3](./apache-spark-33-runtime.md)| Nov 17, 2022 | GA (as of Feb 23, 2023) | Q2/Q3 2024 |Q1 2025 |
32
+
|[Azure Synapse Runtime for Apache Spark 3.3](./apache-spark-33-runtime.md)| Nov 17, 2022 | GA (as of Feb 23, 2023) | Q2/Q3 2024 |3/31/2025 |
41
33
|[Azure Synapse Runtime for Apache Spark 3.2](./apache-spark-32-runtime.md)| July 8, 2022 |__deprecated and soon disabled__| July 8, 2023 |__July 8, 2024__|
42
34
|[Azure Synapse Runtime for Apache Spark 3.1](./apache-spark-3-runtime.md)| May 26, 2021 |__deprecated and soon disabled__| January 26, 2023 |__January 26, 2024__|
43
35
|[Azure Synapse Runtime for Apache Spark 2.4](./apache-spark-24-runtime.md)| December 15, 2020 |__deprecated and soon disabled__| July 29, 2022 |__September 29, 2023__|
0 commit comments