You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight-aks/release-notes/hdinsight-aks-release-notes-archive.md
+71-1Lines changed: 71 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@ title: Archived release notes for Azure HDInsight on AKS
3
3
description: Archived release notes for Azure HDInsight on AKS. Get development tips and details for Trino, Flink, and Spark.
4
4
ms.service: azure-hdinsight-on-aks
5
5
ms.topic: conceptual
6
-
ms.date: 08/05/2024
6
+
ms.date: 09/05/2024
7
7
---
8
8
9
9
# Azure HDInsight on AKS archived release notes
@@ -14,6 +14,76 @@ ms.date: 08/05/2024
14
14
15
15
Azure HDInsight on AKS is one of the most popular services among enterprise customers for open-source analytics on Azure. If you would like to subscribe on release notes, watch releases on this [GitHub repository](https://github.com/Azure/HDInsight-on-aks/releases).
16
16
17
+
### Release date: Aug 05, 2024
18
+
19
+
**This release applies to the following**
20
+
21
+
- Cluster Pool Version: 1.2
22
+
- Cluster Version: 1.2.1
23
+
- AKS version: 1.27
24
+
25
+
### New Features
26
+
27
+
**MSI based SQL authentication**
28
+
Users can now authenticate external Azure SQL DB Metastore with MSI instead of User ID password authentication. This feature helps to further secure the cluster connection with Metastore.
29
+
30
+
**Configurable VM SKUs for Head node, SSH node**
31
+
This functionality allows users to choose specific SKUs for head nodes, worker nodes, and SSH nodes, offering the flexibility to select according to the use case and the potential to lower total cost of ownership (TCO).
32
+
33
+
**Multiple MSI in cluster**
34
+
Users can configure multiple MSI for cluster admins operations and for job related resource access. This feature allows users to demarcate and control the access to the cluster and data lying in the storage account.
35
+
For example, one MSI for access to data in storage account and dedicated MSI for cluster operations.
36
+
37
+
### Updated
38
+
39
+
**Script action**
40
+
Script Action now can be added with Sudo user permission. Users can now install multiple dependencies including custom jars to customize the clusters as required.
41
+
42
+
**Library Management**
43
+
Maven repository shortcut feature added to the Library Management in this release. User can now install Maven dependencies directly from the open-source repositories.
44
+
45
+
**Spark 3.4**
46
+
Spark 3.4 update brings a range of new features includes
47
+
* API enhancements
48
+
* Structured streaming improvements
49
+
* Improved usability and developer experience
50
+
51
+
> [!IMPORTANT]
52
+
> To take benefit of all these **latest features**, you are required to create a new cluster pool with 1.2 and cluster version 1.2.1
53
+
54
+
### Known issues
55
+
56
+
-**Workload identity limitation:**
57
+
- There's a known [limitation](/azure/aks/workload-identity-overview#limitations) when transitioning to workload identity. This limitation is due to the permission-sensitive nature of FIC operations. Users can't perform deletion of a cluster by deleting the resource group. Cluster deletion requests must be triggered by the application/user/principal with FIC/delete permissions. In case, the FIC deletion fails, the high-level cluster deletion also fails.
58
+
-**User Assigned Managed Identities (UAMI)** support – There's a limit of 20 FICs per UAMI. You can only create 20 Federated Credentials on an identity. In HDInsight on AKS cluster, FIC (Federated Identity Credential) and SA have one-to-one mapping and only 20 SAs can be created against an MSI. If you want to create more clusters, then you are required to provide different MSIs to overcome the limitation.
59
+
- Creation of federated identity credentials is currently not supported on user-assigned managed identities created in [these regions](/entra/workload-id/workload-identity-federation-considerations#unsupported-regions-user-assigned-managed-identities)
60
+
61
+
62
+
### Operating System version
63
+
64
+
- Mariner OS 2.0
65
+
66
+
**Workload versions**
67
+
68
+
|Workload|Version|
69
+
| -------- | -------- |
70
+
|Trino | 440 |
71
+
|Flink | 1.17.0 |
72
+
|Apache Spark | 3.4 |
73
+
74
+
**Supported Java and Scala versions**
75
+
76
+
|Workload |Java|Scala|
77
+
| ----------- | -------- | -------- |
78
+
|Trino |Open JDK 21.0.2 |- |
79
+
|Flink |Open JDK 11.0.21 |2.12.7 |
80
+
|Spark |Open JDK 1.8.0_345 |2.12.15 |
81
+
82
+
The preview is available in the following [regions](../overview.md#region-availability-public-preview).
83
+
84
+
If you have any more questions, contact [Azure Support](https://ms.portal.azure.com/#view/Microsoft_Azure_Support/HelpAndSupportBlade/~/overview) or refer to the [Support options](../hdinsight-aks-support-help.md) page. If you have product specific feedback, write us on [aka.ms/askhdinsight](https://forms.office.com/pages/responsepage.aspx?id=v4j5cvGGr0GRqy180BHbR6HHTBN7UDpEhLm8BJmDhGJURDhLWEhBVE5QN0FQRUpHWDg4ODlZSDA4RCQlQCN0PWcu).
0 commit comments