@@ -3,7 +3,7 @@ title: Open-source components and versions - Azure HDInsight 4.0
3
3
description : Learn about the open-source components and versions in Azure HDInsight 4.0.
4
4
ms.service : hdinsight
5
5
ms.topic : conceptual
6
- ms.date : 09/09/2022
6
+ ms.date : 02/16/2023
7
7
---
8
8
9
9
# HDInsight 4.0 component versions
@@ -12,7 +12,7 @@ In this article, you learn about the open-source components and versions in Azur
12
12
13
13
## Open-source components available with HDInsight version 4.0
14
14
15
- The Open-source component versions associated with HDInsight 4.0 are listed in the following table.
15
+ The Open-source component versions associated with HDInsight 4.0 are present in the following table.
16
16
17
17
| Component | HDInsight 4.0 |
18
18
| ------------------------| ---------------|
@@ -32,14 +32,28 @@ The Open-source component versions associated with HDInsight 4.0 are listed in t
32
32
| Apache Ambari | 2.7.0 |
33
33
| Apache Zeppelin | 0.8.0 |
34
34
35
- This table lists certain HDInsight 4.0 cluster types that have retired or will be retired soon.
35
+ This table lists certain HDInsight 4.0 cluster types that have retired or will be retiring soon.
36
36
37
37
| Cluster Type | Framework version | Support expiration date | Retirement date |
38
38
| ---------------------------------| -------------------| ------------------------------| -----------------|
39
39
| HDInsight 4.0 Spark | 2.3 | June 30, 2020 | June 30, 2020 |
40
40
| HDInsight 4.0 Kafka | 1.1 | Dec 31, 2020 | Dec 31, 2020 |
41
41
| HDInsight 4.0 Kafka | 2.1.0 | Sep 30, 2022 | Oct 1, 2022 |
42
42
43
+ ## Spark versions supported in Azure HDInsight
44
+
45
+ Apache Spark versions supported in Azure HDIinsight
46
+
47
+ | Apache Spark version on HDInsight| Release date| Release stage| End of life announcement date| [ End of standard support] ( ) | [ End of basic support] ( ) |
48
+ | --| --| --| --| --| --|
49
+ | 2.4| July 8, 2023 | End of Life Announced (EOLA)| Feb10,2023| Aug 10,2023| Feb 10,2024|
50
+ | 3.1| March 11,2022| GA | -| -| -|
51
+ | 3.3| March 22,2023| Public Preview| -| -| -|
52
+
53
+ ## Apache Spark 2.4 to Spark 3.x Migration Guides
54
+
55
+ Spark 2.4 to Spark 3.x Migration Guides see [ here] ( https://spark.apache.org/docs/latest/migration-guide.html ) .
56
+
43
57
## Next steps
44
58
45
59
- [ Cluster setup for Apache Hadoop, Spark, and more on HDInsight] ( hdinsight-hadoop-provision-linux-clusters.md )
0 commit comments