Skip to content

Commit 553e48e

Browse files
authored
Merge pull request #100654 from yanancai/master
Update HDInsight release notes
2 parents 195f8fc + de26a13 commit 553e48e

File tree

2 files changed

+77
-36
lines changed

2 files changed

+77
-36
lines changed

articles/hdinsight/hdinsight-release-notes-archive.md

Lines changed: 60 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.reviewer: jasonh
77
ms.service: hdinsight
88
ms.topic: conceptual
99
ms.custom: hdinsightactive
10-
ms.date: 12/17/2019
10+
ms.date: 01/08/2019
1111
---
1212

1313
# Archived release notes
@@ -19,6 +19,65 @@ ms.date: 12/17/2019
1919

2020
Azure HDInsight is one of the most popular services among enterprise customers for open-source Apache Hadoop and Apache Spark analytics on Azure.
2121

22+
## Release date: 12/17/2019
23+
24+
This release applies both for HDInsight 3.6 and 4.0.
25+
26+
### New features
27+
28+
#### Service tags
29+
Service tags simplify security for Azure virtual machines and Azure virtual networks by enabling you to easily restrict network access to the Azure services. You can use service tags in your network security group (NSG) rules to allow or deny traffic to a specific Azure service globally or per Azure region. Azure provides the maintenance of IP addresses underlying each tag. HDInsight service tags for network security groups (NSGs) are groups of IP addresses for health and management services. These groups help minimize complexity for security rule creation. HDInsight customers can enable service tag through Azure Portal, PowerShell, and REST API. For more information, see [Network security group (NSG) service tags for Azure HDInsight](https://docs.microsoft.com/azure/hdinsight/hdinsight-service-tags).
30+
31+
#### Custom Ambari DB
32+
HDInsight now allows you to use your own SQL DB for Apache Ambari. You can configure this custom Ambari DB from the Azure portal or through resource manager template. This feature allows you to choose the right SQL DB for your processing and capacity needs. You can also upgrade easily to match business growth requirements. For more information, see [Set up HDInsight clusters with a custom Ambari DB](hdinsight-custom-ambari-db.md).
33+
34+
![Custom Ambari DB](./media/hdinsight-release-notes/custom-ambari-db.png)
35+
36+
### Deprecation
37+
No deprecations for this release. To get ready for upcoming deprecations, see [Upcoming changes](#upcoming-changes).
38+
39+
### Behavior changes
40+
No behavior changes for this release. To get ready for upcoming behavior changes, see [Upcoming changes](#upcoming-changes).
41+
42+
### Upcoming changes
43+
The following changes will happen in upcoming releases.
44+
45+
#### Transport Layer Security (TLS) 1.2 enforcement
46+
Transport Layer Security (TLS) and Secure Sockets Layer (SSL) are cryptographic protocols that provide communications security over a computer network. For more information, see [Transport Layer Security](https://en.wikipedia.org/wiki/Transport_Layer_Security#SSL_1.0.2C_2.0_and_3.0). While Azure HDInsight clusters accept TLS 1.2 connections on public HTTPS endpoints, TLS 1.1 is still supported for backward compatibility with older clients.
47+
48+
Starting from the next release, you will be able to opt-in and configure your new HDInsight clusters to only accept TLS 1.2 connections.
49+
50+
Later in the year, starting on 6/30/2020, Azure HDInsight will enforce TLS 1.2 or later versions for all HTTPS connections. We recommend that you ensure that all your clients are ready to handle TLS 1.2 or later versions.
51+
52+
#### Moving to Azure virtual machine scale sets
53+
HDInsight now uses Azure virtual machines to provision the cluster. Starting from Feburary 2020 (exact date will be communicated later), HDInsight will use Azure virtual machine scale sets instead. See more about [Azure virtual machine scale sets](https://docs.microsoft.com/azure/virtual-machine-scale-sets/overview).
54+
55+
#### ESP Spark cluster node size change
56+
In the upcoming release:
57+
- The minimum allowed node size for ESP Spark cluster will be changed to Standard_D13_V2.
58+
- A-series VMs will be deprecated for creating new ESP clusters, as A-series VMs could cause ESP cluster issues because of relatively low CPU and memory capacity.
59+
60+
#### HBase 2.0 to 2.1
61+
In the upcoming HDInsight 4.0 release, HBase version will be upgraded from version 2.0 to 2.1.
62+
63+
### Bug fixes
64+
HDInsight continues to make cluster reliability and performance improvements.
65+
66+
### Component version change
67+
We've extended HDInsight 3.6 support to December 31, 2020. You can find more details in [Supported HDInsight versions](hdinsight-component-versioning.md#supported-hdinsight-versions).
68+
69+
No component version change for HDInsight 4.0.
70+
71+
Apache Zeppelin on HDInsight 3.6: 0.7.0-->0.7.3.
72+
73+
You can find the most up-to-date component versions from [this doc](https://docs.microsoft.com/azure/hdinsight/hdinsight-component-versioning#apache-hadoop-components-available-with-different-hdinsight-versions).
74+
75+
### New Regions
76+
77+
#### UAE North
78+
The management IPs of UAE North are: `65.52.252.96` and `65.52.252.97`.
79+
80+
2281
## Release date: 11/07/2019
2382

2483
This release applies both for HDInsight 3.6 and 4.0.

articles/hdinsight/hdinsight-release-notes.md

Lines changed: 17 additions & 35 deletions
Original file line numberDiff line numberDiff line change
@@ -7,57 +7,50 @@ ms.reviewer: jasonh
77
ms.custom: hdinsightactive
88
ms.service: hdinsight
99
ms.topic: conceptual
10-
ms.date: 12/17/2019
10+
ms.date: 01/08/2019
1111
---
1212
# Release notes
1313

1414
This article provides information about the **most recent** Azure HDInsight release updates. For information on earlier releases, see [HDInsight Release Notes Archive](hdinsight-release-notes-archive.md).
1515

1616
## Summary
1717

18-
Azure HDInsight is one of the most popular services among enterprise customers for open-source Apache Hadoop and Apache Spark analytics on Azure.
18+
Azure HDInsight is one of the most popular services among enterprise customers for open-source analytics on Azure.
1919

20-
## Release date: 12/17/2019
20+
## Release date: 01/09/2019
2121

22-
This release applies both for HDInsight 3.6 and 4.0.
22+
This release applies both for HDInsight 3.6 and 4.0. HDInsight release is made available to all regions over several days. The release date here indicates the first region release date. If you don't see below changes, please wait for the release being live in your region in several days.
2323

2424
> [!IMPORTANT]
2525
> Linux is the only operating system used on HDInsight version 3.4 or greater. For more information, see [HDInsight versioning article](hdinsight-component-versioning.md).
2626
27-
2827
## New features
28+
### TLS 1.2 enforcement
29+
Transport Layer Security (TLS) and Secure Sockets Layer (SSL) are cryptographic protocols that provide communications security over a computer network. Learn more about [TLS](https://en.wikipedia.org/wiki/Transport_Layer_Security#SSL_1.0.2C_2.0_and_3.0). HDInsight uses TLS 1.2 on public HTTPs endpoints but TLS 1.1 is still supported for backward compatibility.
2930

30-
### Service tags
31-
Service tags simplify security for Azure virtual machines and Azure virtual networks by enabling you to easily restrict network access to the Azure services. You can use service tags in your network security group (NSG) rules to allow or deny traffic to a specific Azure service globally or per Azure region. Azure provides the maintenance of IP addresses underlying each tag. HDInsight service tags for network security groups (NSGs) are groups of IP addresses for health and management services. These groups help minimize complexity for security rule creation. HDInsight customers can enable service tag through Azure Portal, PowerShell, and REST API. For more information, see [Network security group (NSG) service tags for Azure HDInsight](https://docs.microsoft.com/azure/hdinsight/hdinsight-service-tags).
32-
33-
### Custom Ambari DB
34-
HDInsight now allows you to use your own SQL DB for Apache Ambari. You can configure this custom Ambari DB from the Azure portal or through resource manager template. This feature allows you to choose the right SQL DB for your processing and capacity needs. You can also upgrade easily to match business growth requirements. For more information, see [Set up HDInsight clusters with a custom Ambari DB](hdinsight-custom-ambari-db.md).
31+
From this release, cusotmers can opt-in TLS 1.2 enformence for all connections through TLS 1.2. A new property **minSupportedTlsVersion** is introduced via Azure Resource Manager template for cluster creation. If the property is not set, the cluster still supports 1.0, 1.1 and 1.2, same as today's behavior. Customers can set the value for this property to "1.2", which means that the cluster only supports TLS 1.2 and above.
3532

36-
![Custom Ambari DB](./media/hdinsight-release-notes/custom-ambari-db.png)
33+
### Bring your own key for disk encryption
34+
All managed disks in HDInsight are protected with Azure Storage Service Encryption (SSE). Data on those disks is encrypted by Microsoft-managed keys by default. Starting from this release, you can Bring Your Own Key (BYOK) for disk encryption and manage it using Azure Key Vault. BYOK encryption is a one-step configuration during cluster creation with no additional cost. Just register HDInsight as a managed identity with Azure Key Vault and add the encryption key when you create your cluster.
3735

3836
## Deprecation
3937
No deprecations for this release. To get ready for upcoming deprecations, see [Upcoming changes](#upcoming-changes).
4038

4139
## Behavior changes
42-
No behavior changes for this release. To get ready for upcoming behavior changes, see [Upcoming changes](#upcoming-changes).
40+
No behavior changes for this release. To get ready for upcoming changes, see [Upcoming changes](#upcoming-changes).
4341

4442
## Upcoming changes
4543
The following changes will happen in upcoming releases.
4644

47-
### Transport Layer Security (TLS) 1.2 enforcement
48-
Transport Layer Security (TLS) and Secure Sockets Layer (SSL) are cryptographic protocols that provide communications security over a computer network. For more information, see [Transport Layer Security](https://en.wikipedia.org/wiki/Transport_Layer_Security#SSL_1.0.2C_2.0_and_3.0). While Azure HDInsight clusters accept TLS 1.2 connections on public HTTPS endpoints, TLS 1.1 is still supported for backward compatibility with older clients.
49-
50-
Starting from the next release, you will be able to opt-in and configure your new HDInsight clusters to only accept TLS 1.2 connections.
45+
### A minimum 4-core VM is required for Head Node
46+
A minimum 4-core VM is required for Head Node to ensure the high availability and reliability of HDInsight clusters. Starting from April 6th 2020, customers can only choose 4-core or above VM as Head Node for the new HDInsight clusters. Existing clusters will continue to run as expected.
5147

52-
Later in the year, starting on 6/30/2020, Azure HDInsight will enforce TLS 1.2 or later versions for all HTTPS connections. We recommend that you ensure that all your clients are ready to handle TLS 1.2 or later versions.
48+
### ESP Spark cluster node size change
49+
In the upcoming release, the minimum allowed node size for ESP Spark cluster will be changed to Standard_D13_V2.
50+
A-series VMs could cause ESP cluster issues because of relatively low CPU and memory capacity. A-series VMs will be deprecated for creating new ESP clusters.
5351

5452
### Moving to Azure virtual machine scale sets
55-
HDInsight now uses Azure virtual machines to provision the cluster. Starting from Feburary 2020 (exact date will be communicated later), HDInsight will use Azure virtual machine scale sets instead. See more about [Azure virtual machine scale sets](https://docs.microsoft.com/azure/virtual-machine-scale-sets/overview).
56-
57-
### ESP Spark cluster node size change
58-
In the upcoming release:
59-
- The minimum allowed node size for ESP Spark cluster will be changed to Standard_D13_V2.
60-
- A-series VMs will be deprecated for creating new ESP clusters, as A-series VMs could cause ESP cluster issues because of relatively low CPU and memory capacity.
53+
HDInsight now uses Azure virtual machines to provision the cluster. In the upcoming release, HDInsight will use Azure virtual machine scale sets instead. See more about Azure virtual machine scale sets.
6154

6255
### HBase 2.0 to 2.1
6356
In the upcoming HDInsight 4.0 release, HBase version will be upgraded from version 2.0 to 2.1.
@@ -66,15 +59,4 @@ In the upcoming HDInsight 4.0 release, HBase version will be upgraded from versi
6659
HDInsight continues to make cluster reliability and performance improvements.
6760

6861
## Component version change
69-
We've extended HDInsight 3.6 support to December 31, 2020. You can find more details in [Supported HDInsight versions](hdinsight-component-versioning.md#supported-hdinsight-versions).
70-
71-
No component version change for HDInsight 4.0.
72-
73-
Apache Zeppelin on HDInsight 3.6: 0.7.0-->0.7.3.
74-
75-
You can find the most up-to-date component versions from [this doc](https://docs.microsoft.com/azure/hdinsight/hdinsight-component-versioning#apache-hadoop-components-available-with-different-hdinsight-versions).
76-
77-
## New Regions
78-
79-
### UAE North
80-
The management IPs of UAE North are: `65.52.252.96` and `65.52.252.97`.
62+
No component version change for this release. You could find the current component versions for HDInsight 4.0 ad HDInsight 3.6 here.

0 commit comments

Comments
 (0)