You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight-aks/release-notes/hdinsight-aks-release-notes.md
+25-23Lines changed: 25 additions & 23 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@ title: Release notes for Azure HDInsight on AKS
3
3
description: Latest release notes for Azure HDInsight on AKS. Get development tips and details for Trino, Flink, Spark, and more.
4
4
ms.service: hdinsight-aks
5
5
ms.topic: conceptual
6
-
ms.date: 03/20/2024
6
+
ms.date: 08/05/2024
7
7
---
8
8
9
9
# Azure HDInsight on AKS release notes
@@ -29,40 +29,42 @@ You can refer to [What's new](../whats-new.md) page for all the details of the f
29
29
30
30
## Release Information
31
31
32
-
### Release date: March 20, 2024
32
+
### Release date: Aug 05, 2024
33
33
34
34
**This release applies to the following**
35
35
36
-
- Cluster Pool Version: 1.1
37
-
- Cluster Version: 1.1.1
36
+
- Cluster Pool Version: 1.2
37
+
- Cluster Version: 1.2.1
38
38
- AKS version: 1.27
39
39
40
-
41
40
### New Features
42
41
43
-
**Apache Flink Application Mode Cluster**
44
-
45
-
Application mode clusters are designed to support dedicated resources for large and long-running jobs. When you have resource-intensive or extensive data processing tasks, you can use the [Application Mode Cluster](https://flink.apache.org/2020/07/14/application-deployment-in-flink-current-state-and-the-new-application-mode/#application-mode). This mode allows you to allocate dedicated resources for specific Apache Flink applications, ensuring that they have the necessary computing power and memory to handle large workloads effectively.
46
-
47
-
For more information, see [Apache Flink Application Mode cluster on HDInsight on AKS](../flink/application-mode-cluster-on-hdinsight-on-aks.md).
42
+
**MSI based SQL authentication**
43
+
Users can now authenticate external Azure SQL DB Metastore with MSI instead of User ID password authentication. This feature helps to further secure the cluster connection with Metastore.
48
44
49
-
**Private Clusters for HDInsight on AKS**
45
+
**Configurable VM SKUs for Head node, SSH node**
46
+
This functionality allows users to choose specific SKUs for head nodes, worker nodes, and SSH nodes, offering the flexibility to select according to the use case and the potential to lower total cost of ownership (TCO).
50
47
51
-
With private clusters, and outbound cluster settings you can now control ingress and egress traffic from HDInsight on AKS cluster pools and clusters.
48
+
**Multiple MSI in cluster**
49
+
Users can configure multiple MSI for cluster admins operations and for job related resource access. This feature allows users to demarcate and control the access to the cluster and data lying in the storage account.
50
+
For example, one MSI for access to data in storage account and dedicated MSI for cluster operations.
52
51
53
-
- Use Azure Firewall or Network Security Groups (NSGs) to control the egress traffic, when you opt to use outbound cluster pool with load balancer.
54
-
- Use Outbound cluster pool with User defined routing to control egress traffic at the subnet level.
55
-
- Use Private AKS cluster feature - To ensure AKS control plane, or API server has internal IP addresses. The network traffic between AKS Control plane / API server and HDInsight on AKS node pools (clusters) remains on the private network only.
56
-
- Avoid creating public IPs for the cluster. Use private ingress feature on your clusters.
52
+
### Updated
57
53
58
-
For more information, see [Control network traffic from HDInsight on AKS Cluster pools and cluster](../control-egress-traffic-from-hdinsight-on-aks-clusters.md).
54
+
**Script action**
55
+
Script Action now can be added with Sudo user permission. Users can now install multiple dependencies including custom jars to customize the clusters as required.
59
56
60
-
**In place Upgrade**
57
+
**Library Management**
58
+
Maven repository shortcut feature added to the Library Management in this release. User can now install Maven dependencies directly from the open-source repositories.
61
59
62
-
Upgrade your clusters and cluster pools with the latest software updates. This means that you can enjoy the latest cluster package hotfixes, security updates, and AKS patches, without recreating clusters. For more information, see [Upgrade your HDInsight on AKS clusters and cluster pools](../in-place-upgrade.md).
60
+
**Spark 3.4**
61
+
Spark 3.4 update brings a range of new features includes
62
+
* API enhancements
63
+
* Structured streaming improvements
64
+
* Improved usability and developer experience
63
65
64
66
> [!IMPORTANT]
65
-
> To take benefit of all these **latest features**, you are required to create a new cluster pool with 1.1 and cluster version 1.1.1.
67
+
> To take benefit of all these **latest features**, you are required to create a new cluster pool with 1.2 and cluster version 1.2.1
66
68
67
69
### Known issues
68
70
@@ -80,15 +82,15 @@ Upgrade your clusters and cluster pools with the latest software updates. This m
0 commit comments