Skip to content

Commit 11ff562

Browse files
authored
Merge pull request #242812 from sreekzz/patch-187
Update Release Notes for July 2023
2 parents 03fef00 + 3cc6fa6 commit 11ff562

File tree

4 files changed

+25
-46
lines changed

4 files changed

+25
-46
lines changed

articles/hdinsight/hdinsight-release-notes.md

Lines changed: 13 additions & 46 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ description: Latest release notes for Azure HDInsight. Get development tips and
44
ms.custom: references_regions
55
ms.service: hdinsight
66
ms.topic: conceptual
7-
ms.date: 05/12/2023
7+
ms.date: 07/28/2023
88
---
99

1010
# Azure HDInsight release notes
@@ -18,74 +18,41 @@ Subscribe to the [HDInsight Release Notes](./subscribe-to-hdi-release-notes-rep
1818

1919
To subscribe, click the “watch” button in the banner and watch out for [HDInsight Releases](https://github.com/Azure/HDInsight/releases).
2020

21-
## Release date: May 08, 2023
21+
## Release date: July 25, 2023
2222

23-
This release applies to HDInsight 4.x and 5.x HDInsight release will be available to all regions over several days. This release is applicable for image number **2304280205**. [How to check the image number?](./view-hindsight-cluster-image-version.md)
23+
This release applies to HDInsight 4.x and 5.x HDInsight release will be available to all regions over several days. This release is applicable for image number **2307201242**. [How to check the image number?](./view-hindsight-cluster-image-version.md)
2424

2525
HDInsight uses safe deployment practices, which involve gradual region deployment. it may take up to 10 business days for a new release or a new version to be available in all regions.
2626

2727
**OS versions**
2828

2929
* HDInsight 4.0: Ubuntu 18.04.5 LTS Linux Kernel 5.4
3030
* HDInsight 5.0: Ubuntu 18.04.5 LTS Linux Kernel 5.4
31+
* HDInsight 5.1: Ubuntu 18.04.5 LTS Linux Kernel 5.4
3132

3233
For workload specific versions, see
3334

3435
* [HDInsight 5.x component versions](./hdinsight-5x-component-versioning.md)
3536
* [HDInsight 4.x component versions](./hdinsight-40-component-versioning.md)
3637

37-
![Icon showing update with text.](media/hdinsight-release-notes/new-icon-for-updated.png)
38+
## ![Icon showing Whats new.](./media/hdinsight-release-notes/whats-new.svg) What's new
39+
* HDInsight 5.1 is now supported with ESP cluster.
40+
* Upgraded version of Ranger 2.3.0 and Oozie 5.2.1 are now part of HDInsight 5.1
41+
* The Spark 3.3.1 (HDInsight 5.1) cluster comes with Hive Warehouse Connector (HWC) 2.1, which works together with the Interactive Query (HDInsight 5.1) cluster.
3842

39-
1. Azure HDInsight 5.1 updated with
43+
## ![Icon showing coming soon.](./media/hdinsight-release-notes/clock.svg) Coming soon
4044

41-
1. Apache HBase 2.4.11
42-
1. Apache Phoenix 5.1.2
43-
1. Apache Hive 3.1.2
44-
1. Apache Spark 3.3.1
45-
1. Apache Tez 0.9.1
46-
1. Apache Zeppelin 0.10.1
47-
1. Apache Livy 0.5
48-
1. Apache Kafka 3.2.0
49-
50-
> [!NOTE]
51-
> * All components are integrated with Hadoop 3.3.4 & ZK 3.6.3
52-
> * All above upgraded components are now available in non-ESP clusters for public preview.
53-
54-
![Icon showing new features with text.](media/hdinsight-release-notes/new-icon-for-new-feature.png)
55-
56-
1. **Enhanced Autoscale for HDInsight**
57-
58-
Azure HDInsight has made notable improvements stability and latency on Autoscale, The essential changes include improved feedback loop for scaling decisions, significant improvement on latency for scaling and support for recommissioning the decommissioned nodes, Learn [more](https://techcommunity.microsoft.com/t5/analytics-on-azure-blog/enhanced-autoscale-capabilities-in-hdinsight-clusters/ba-p/3811271) about the enhancements, how to custom configure and migrate your cluster to enhanced autoscale. The enhanced Autoscale capability is available effective 17 May, 2023 across all supported regions.
59-
60-
1. **Azure HDInsight ESP for Apache Kafka 2.4.1 is now Generally Available**.
61-
62-
Azure HDInsight ESP for Apache Kafka 2.4.1 has been in public preview since April 2022. After notable improvements in CVE fixes and stability, Azure HDInsight ESP Kafka 2.4.1 now becomes generally available and ready for production workloads, learn the detail about the [how to configure](./domain-joined/apache-domain-joined-run-kafka.md) and [migrate](./kafka/migrate-versions.md).
63-
64-
1. **Quota Management for HDInsight**
65-
66-
HDInsight currently allocates quota to customer subscriptions at a regional level. The cores allocated to customers are generic and not classified at a VM family level (For example, Dv2, Ev3, Eav4, etc.).
67-
68-
HDInsight introduced an improved view, which provides a detail and classification of quotas for family-level VMs, this feature allows customers to view current and remaining quotas for a region at the VM family level. With the enhanced view, customers have richer visibility, for planning quotas, and a better user experience. This feature is currently available on HDInsight 4.x and 5.x for East US EUAP region. Other regions to follow later.
69-
70-
For more information, see [Cluster capacity planning in Azure HDInsight | Microsoft Learn](./hdinsight-capacity-planning.md#view-quota-management-for-hdinsight)
71-
72-
![Icon showing new regions added with text.](media/hdinsight-release-notes/new-icon-for-new-regions-added.png)
73-
74-
* Poland Central
75-
76-
## Coming soon
77-
78-
* The max length of cluster name will be changed to 45 from 59 characters, to improve the security posture of clusters.
45+
* The max length of cluster name will be changed to 45 from 59 characters, to improve the security posture of clusters. Customers need to plan for the updates before 30 September 2023.
7946
* Cluster permissions for secure storage
8047
* Customers can specify (during cluster creation) whether a secure channel should be used for HDInsight cluster nodes to contact the storage account.
8148
* In-line quota update.
8249
* Request quotas increase directly from the My Quota page, which will be a direct API call, which is faster. If the API call fails, then customers need to create a new support request for quota increase.
8350
* HDInsight Cluster Creation with Custom VNets.
84-
* To improve the overall security posture of the HDInsight clusters, HDInsight clusters using custom VNETs will need to ensure that the user needs to have permission for `Microsoft Network/virtualNetworks/subnets/join/action` to perform create operations. Customers would need to plan accordingly as this would be a mandatory check to avoid cluster creation failures.
51+
* To improve the overall security posture of the HDInsight clusters, HDInsight clusters using custom VNETs need to ensure that the user needs to have permission for `Microsoft Network/virtualNetworks/subnets/join/action` to perform create operations. Customers would need to plan accordingly as this change would be a mandatory check to avoid cluster creation failures before 30 September 2023. 
8552
* Basic and Standard A-series VMs Retirement.
8653
* On 31 August 2024, we'll retire Basic and Standard A-series VMs. Before that date, you need to migrate your workloads to Av2-series VMs, which provide more memory per vCPU and faster storage on solid-state drives (SSDs). To avoid service disruptions, [migrate your workloads](https://aka.ms/Av1retirement) from Basic and Standard A-series VMs to Av2-series VMs before 31 August 2024.
87-
* Non-ESP ABFS clusters [Cluster Permissions for World Readable]
88-
* Plan to introduce a change in non-ESP ABFS clusters, which restricts non-Hadoop group users from executing Hadoop commands for storage operations. This change to improve cluster security posture. Customers need to plan for the updates.
54+
* Non-ESP ABFS clusters [Cluster Permissions for Word Readable]
55+
* Plan to introduce a change in non-ESP ABFS clusters, which restricts non-Hadoop group users from executing Hadoop commands for storage operations. This change to improve cluster security posture. Customers need to plan for the updates before 30 September 2023. 
8956

9057
If you have any more questions, contact [Azure Support](https://ms.portal.azure.com/#view/Microsoft_Azure_Support/HelpAndSupportBlade/~/overview).
9158

Lines changed: 4 additions & 0 deletions
Loading
Lines changed: 5 additions & 0 deletions
Loading
Lines changed: 3 additions & 0 deletions
Loading

0 commit comments

Comments
 (0)