@@ -3,7 +3,7 @@ title: Open-source components and versions - Azure HDInsight 5.0
3
3
description : Learn about the open-source components and versions in Azure HDInsight 5.0.
4
4
ms.service : hdinsight
5
5
ms.topic : conceptual
6
- ms.date : 08/25/2022
6
+ ms.date : 02/22/2023
7
7
---
8
8
9
9
# HDInsight 5.0 component versions
@@ -39,6 +39,20 @@ This table lists certain HDInsight 4.0 cluster types that have retired or will b
39
39
| ---------------------------------| -------------------| ------------------------------| -----------------|
40
40
| HDInsight 4.0 Kafka | 2.1.0 | Sep 30, 2022 | Oct 1, 2022 |
41
41
42
+ ## Spark versions supported in Azure HDInsight
43
+
44
+ Apache Spark versions supported in Azure HDIinsight
45
+
46
+ | Apache Spark version on HDInsight| Release date| Release stage| End of life announcement date| [ End of standard support] ( ) | [ End of basic support] ( ) |
47
+ | --| --| --| --| --| --|
48
+ | 2.4| July 8, 2019| End of Life Announced (EOLA)| Feb10,2023| Aug 10,2023| Feb 10,2024|
49
+ | 3.1| March 11,2022| GA | -| -| -|
50
+ | 3.3| March 22,2023| Public Preview| -| -| -|
51
+
52
+ ## Apache Spark 2.4 to Spark 3.x Migration Guides
53
+
54
+ Spark 2.4 to Spark 3.x Migration Guides see [ here] ( https://spark.apache.org/docs/latest/migration-guide.html ) .
55
+
42
56
## Spark
43
57
44
58
:::image type="content" source="./media/hdinsight-release-notes/spark-3-1-for-hdi-5-0.png" alt-text="Screenshot of Spark 3.1 for HDI 5.0":::
@@ -80,5 +94,3 @@ HDInsight team is working on upgrading other open-source components.
80
94
- [ Cluster setup for Apache Hadoop, Spark, and more on HDInsight] ( hdinsight-hadoop-provision-linux-clusters.md )
81
95
- [ Enterprise Security Package] ( ./enterprise-security-package.md )
82
96
- [ Work in Apache Hadoop on HDInsight from a Windows PC] ( hdinsight-hadoop-windows-tools.md )
83
-
84
-
0 commit comments