Skip to content

Commit 204034c

Browse files
sreekzzsreekzz
authored
Updated Archived Release Notes
Updated Archived Release Notes
1 parent c28cc61 commit 204034c

File tree

1 file changed

+87
-2
lines changed

1 file changed

+87
-2
lines changed

‎articles/hdinsight/hdinsight-release-notes-archive.md

Lines changed: 87 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,10 @@
11
---
22
title: Archived release notes for Azure HDInsight
3-
description: Archived release notes for Azure HDInsight. Get development tips and details for Hadoop, Spark, R Server, Hive and more.
3+
description: Archived release notes for Azure HDInsight. Get development tips and details for Hadoop, Spark, Hive and more.
44
ms.service: hdinsight
55
ms.topic: conceptual
66
ms.custom: hdinsightactive, references_regions
7-
ms.date: 12/09/2022
7+
ms.date: 02/28/2023
88
---
99

1010
# Archived release notes
@@ -14,6 +14,91 @@ ms.date: 12/09/2022
1414
Azure HDInsight is one of the most popular services among enterprise customers for open-source analytics on Azure.
1515
If you would like to subscribe on release notes, watch releases on [this GitHub repository](https://github.com/hdinsight/release-notes/releases).
1616

17+
## Release date: December 12, 2022
18+
19+
This release applies to HDInsight 4.0. and 5.0 HDInsight release is made available to all regions over several days.
20+
21+
HDInsight uses safe deployment practices, which involve gradual region deployment. It may take up to 10 business days for a new release or a new version to be available in all regions.
22+
23+
**OS versions**
24+
25+
* HDInsight 4.0: Ubuntu 18.04.5 LTS Linux Kernel 5.4
26+
* HDInsight 5.0: Ubuntu 18.04.5 LTS Linux Kernel 5.4
27+
28+
For workload specific versions, see [here.](./hdinsight-40-component-versioning.md)
29+
30+
![Icon showing new features with text.](media/hdinsight-release-notes/new-icon-for-new-feature.png)
31+
32+
* **Log Analytics** - Customers can enable classic monitoring to get the latest OMS version 14.19. To remove old versions, disable and enable classic monitoring.
33+
* **Ambari** user auto UI logout due to inactivity. For more information, see [here](./ambari-web-ui-auto-logout.md)
34+
* **Spark** - A new and optimized version of Spark 3.1.3 is included in this release. We tested Apache Spark 3.1.2(previous version) and Apache Spark 3.1.3(current version) using the TPC-DS benchmark. The test was carried out using E8 V3  SKU, for Apache Spark on 1-TB workload. Apache Spark 3.1.3 (current version) outperformed Apache Spark 3.1.2 (previous version) by over 40% in total query runtime for TPC-DS queries using the same hardware specs. The Microsoft Spark team added optimizations available in Azure Synapse with Azure HDInsight. For more information, please refer to [ Speed up your data workloads with performance updates to Apache Spark 3.1.2 in Azure Synapse](https://techcommunity.microsoft.com/t5/azure-synapse-analytics-blog/speed-up-your-data-workloads-with-performance-updates-to-apache/ba-p/2769467)
35+
36+
![Icon showing new regions added with text.](media/hdinsight-release-notes/new-icon-for-new-regions-added.png)
37+
38+
* Qatar Central
39+
* Germany North
40+
41+
![Icon showing what's changed with text.](media/hdinsight-release-notes/new-icon-for-changed.png)
42+
43+
* HDInsight has moved away from Azul Zulu Java JDK 8 to Adoptium Temurin JDK 8, which supports high-quality TCK certified runtimes, and associated technology for use across the Java ecosystem.
44+
45+
* HDInsight has migrated to reload4j. The log4j changes are applicable to
46+
47+
* Apache Hadoop
48+
* Apache Zookeeper
49+
* Apache Oozie
50+
* Apache Ranger
51+
* Apache Sqoop
52+
* Apache Pig
53+
* Apache Ambari
54+
* Apache Kafka
55+
* Apache Spark
56+
* Apache Zeppelin
57+
* Apache Livy
58+
* Apache Rubix
59+
* Apache Hive
60+
* Apache Tez
61+
* Apache HBase
62+
* OMI
63+
* Apache Pheonix
64+
65+
![Icon showing update with text.](media/hdinsight-release-notes/new-icon-for-updated.png)
66+
67+
HDInsight will implement TLS1.2 going forward, and earlier versions will be updated on the platform. If you're running any applications on top of HDInsight and they use TLS 1.0 and 1.1, upgrade to TLS 1.2 to avoid any disruption in services.
68+
69+
For more information, see [How to enable Transport Layer Security (TLS)](/mem/configmgr/core/plan-design/security/enable-tls-1-2-client)
70+
71+
72+
![Icon showing end of support with text.](media/hdinsight-release-notes/new-icon-for-end-of-support.png)
73+
74+
End of support for Azure HDInsight clusters on Ubuntu 16.04 LTS from 30 November 2022. HDInsight had begun release of cluster images using Ubuntu 18.04 from June 27, 2021. We recommend our customers who are running clusters using Ubuntu 16.04 is to rebuild their clusters with the latest HDInsight images by 30 November 2022.
75+
76+
For more information on how to check Ubuntu version of cluster, see [here](https://learnubuntu.com/check-ubuntu-version)
77+
78+
1. Execute the command “lsb_release -a” in the terminal.
79+
80+
1. If the value for “Description” property in output is “Ubuntu 16.04 LTS”, then this update is applicable to the cluster.
81+
82+
![Icon showing bug fixes with text.](media/hdinsight-release-notes/new-icon-for-bugfix.png)
83+
84+
* Support for Availability Zones selection for Kafka and HBase (write access) clusters.
85+
86+
## Open source bug fixes
87+
88+
**Hive bug fixes**
89+
90+
|Bug Fixes|Apache JIRA|
91+
|---|---|
92+
|[HIVE-26127](https://issues.apache.org/jira/browse/HIVE-26127)| INSERT OVERWRITE error - File Not Found|
93+
|[HIVE-24957](https://issues.apache.org/jira/browse/HIVE-24957)| Wrong results when subquery has COALESCE in correlation predicate|
94+
|[HIVE-24999](https://issues.apache.org/jira/browse/HIVE-24999)| HiveSubQueryRemoveRule generates invalid plan for IN subquery with multiple correlations|
95+
|[HIVE-24322](https://issues.apache.org/jira/browse/HIVE-24322)| If there's direct insert, the attempt ID has to be checked when reading the manifest fails|
96+
|[HIVE-23363](https://issues.apache.org/jira/browse/HIVE-23363)| Upgrade DataNucleus dependency to 5.2 |
97+
|[HIVE-26412](https://issues.apache.org/jira/browse/HIVE-26412)| Create interface to fetch available slots and add the default|
98+
|[HIVE-26173](https://issues.apache.org/jira/browse/HIVE-26173)| Upgrade derby to 10.14.2.0|
99+
|[HIVE-25920](https://issues.apache.org/jira/browse/HIVE-25920)| Bump Xerce2 to 2.12.2.|
100+
|[HIVE-26300](https://issues.apache.org/jira/browse/HIVE-26300)| Upgrade Jackson data bind version to 2.12.6.1+ to avoid CVE-2020-36518|
101+
17102
## Release date: 08/10/2022
18103

19104
This release applies to HDInsight 4.0.  HDInsight release is made available to all regions over several days.

0 commit comments

Comments
 (0)