Skip to content

Commit b064968

Browse files
authored
Merge pull request #114552 from dagiro/freshness_c68
freshness_c68
2 parents 082bade + 1f923e5 commit b064968

7 files changed

+74
-53
lines changed

articles/hdinsight/TOC.yml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -37,8 +37,10 @@
3737
href: https://azure.microsoft.com/resources/samples/?service=hdinsight
3838
- name: Concepts
3939
items:
40-
- name: Apache Hadoop components on HDInsight
40+
- name: Apache components on HDInsight
4141
href: ./hdinsight-component-versioning.md
42+
- name: Enterprise Security Package
43+
href: ./enterprise-security-package.md
4244
- name: Hortonworks release notes
4345
href: ./hortonworks-release-notes.md
4446
- name: High availability components
Lines changed: 62 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
---
2+
title: Enterprise Security Package for Azure HDInsight
3+
description: Learn the Enterprise Security Package components and versions in Azure HDInsight.
4+
author: hrasheed-msft
5+
ms.author: hrasheed
6+
ms.reviewer: jasonh
7+
ms.service: hdinsight
8+
ms.topic: conceptual
9+
ms.date: 05/08/2020
10+
---
11+
12+
# Enterprise Security Package for Azure HDInsight
13+
14+
Enterprise Security is an optional package that you can add on your HDInsight cluster as part of create cluster workflow. The Enterprise Security Package supports:
15+
16+
* Integration with Active Directory for authentication.
17+
18+
In the past, you created HDInsight clusters with local admin user and local SSH user. The local admin user can access all the files, folders, tables, and columns. With Enterprise Security Package, you enable role-based access control by integrating HDInsight with your Active Directory. Which includes on-premises Active Directory, Azure Active Directory Domain Services. Or Active Directory on IaaS virtual machine. Domain administrator on the cluster can grant users to use their own corporate (domain) user-name and password.
19+
20+
For more information, see:
21+
22+
* [An introduction to Apache Hadoop security with domain-joined HDInsight clusters](./domain-joined/hdinsight-security-overview.md)
23+
24+
* [Plan Azure domain-joined Apache Hadoop clusters in HDInsight](./domain-joined/apache-domain-joined-architecture.md)
25+
26+
* [Configure domain-joined sandbox environment](./domain-joined/apache-domain-joined-configure.md)
27+
28+
* [Configure Domain-joined HDInsight clusters using Azure Active Directory Domain Services](./domain-joined/apache-domain-joined-configure-using-azure-adds.md)
29+
30+
* Authorization for data
31+
32+
* Integration with Apache Ranger for authorization for Hive, Spark SQL, and Yarn Queues.
33+
* You can set access control on files and folders.
34+
35+
For more information, see [Configure Apache Hive policies in Domain-joined HDInsight](./domain-joined/apache-domain-joined-run-hive.md)
36+
37+
* View the audit logs to monitor accesses and the configured policies.
38+
39+
## Supported cluster types
40+
41+
Currently, only the following cluster types support the Enterprise Security Package:
42+
43+
* Hadoop (HDInsight 3.6 only)
44+
* Spark
45+
* Kafka
46+
* HBase
47+
* Interactive Query
48+
49+
## Support for Azure Data Lake Storage
50+
51+
The Enterprise Security Package supports using Azure Data Lake Storage as both the primary storage and the add-on storage.
52+
53+
## Pricing and service level agreement (SLA)
54+
55+
For information on pricing and SLA for the Enterprise Security Package, see [HDInsight pricing](https://azure.microsoft.com/pricing/details/hdinsight/).
56+
57+
## Next steps
58+
59+
* [Cluster setup for Apache Hadoop, Spark, and more on HDInsight](hdinsight-hadoop-provision-linux-clusters.md)
60+
* [Work in Apache Hadoop on HDInsight from a Windows PC](hdinsight-hadoop-windows-tools.md)
61+
* [Hortonworks release notes associated with Azure HDInsight versions](./hortonworks-release-notes.md)
62+
* [Apache components on HDInsight](./hdinsight-component-versioning.md)

articles/hdinsight/hadoop/apache-hadoop-dotnet-csharp-mapreduce-streaming.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ Apache Hadoop streaming allows you to run MapReduce jobs using a script or execu
1818

1919
## .NET on HDInsight
2020

21-
HDInsight clusters use [Mono (https://mono-project.com)](https://mono-project.com) to run .NET applications. Mono version 4.2.1 is included with HDInsight version 3.6. For more information on the version of Mono included with HDInsight, see [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-hadoop-components-available-with-different-hdinsight-versions).
21+
HDInsight clusters use [Mono (https://mono-project.com)](https://mono-project.com) to run .NET applications. Mono version 4.2.1 is included with HDInsight version 3.6. For more information on the version of Mono included with HDInsight, see [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions).
2222

2323
For more information on Mono compatibility with .NET Framework versions, see [Mono compatibility](https://www.mono-project.com/docs/about-mono/compatibility/).
2424

articles/hdinsight/hadoop/apache-hadoop-on-premises-migration-best-practices-infrastructure.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,7 @@ Applications or components that were available in on-premises clusters but aren'
7171
|Palantir|IaaS 
7272
|Sailpoint|Iaas 
7373

74-
For more information, see the article [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-hadoop-components-available-with-different-hdinsight-versions)
74+
For more information, see the article [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions)
7575

7676
## Customize HDInsight clusters using script actions
7777

articles/hdinsight/hadoop/hdinsight-troubleshoot-cluster-creation-fails.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,7 @@ Ensure that there are no [locks on your virtual network and resource group](../.
6464

6565
## Unsupported component versions
6666

67-
Ensure that you are using a [supported version of Azure HDInsight](../hdinsight-component-versioning.md) and any [Apache Hadoop components](../hdinsight-component-versioning.md#apache-hadoop-components-available-with-different-hdinsight-versions) in your solution.
67+
Ensure that you are using a [supported version of Azure HDInsight](../hdinsight-component-versioning.md) and any [Apache Hadoop components](../hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions) in your solution.
6868

6969
## Storage account name restrictions
7070

articles/hdinsight/hdinsight-component-versioning.md

Lines changed: 5 additions & 48 deletions
Original file line numberDiff line numberDiff line change
@@ -7,14 +7,14 @@ ms.reviewer: jasonh
77
ms.service: hdinsight
88
ms.topic: conceptual
99
ms.custom: hdinsightactive,hdiseo17may2017,seoapr2020
10-
ms.date: 04/09/2020
10+
ms.date: 05/08/2020
1111
---
1212

13-
# What are the Apache Hadoop components and versions available with HDInsight?
13+
# Apache components and versions available for Azure HDInsight
1414

1515
Learn about the [Apache Hadoop](https://hadoop.apache.org/) environment components and versions in Microsoft Azure HDInsight, and the Enterprise Security Package. Also, learn how to check Hadoop component versions in HDInsight.
1616

17-
## Apache Hadoop components available with different HDInsight versions
17+
## Apache components available with different HDInsight versions
1818

1919
Azure HDInsight supports multiple Hadoop cluster versions that can be deployed at any time. On April 4, 2017, the default cluster version used by Azure HDInsight is 3.6.
2020

@@ -48,7 +48,7 @@ The component versions associated with HDInsight cluster versions are listed in
4848
> [!NOTE]
4949
> Due to system performance considerations, support for Kafka version 0.10 was expired in March 2019.
5050
51-
## Check for current Hadoop component version information
51+
## Check for current Apache component version information
5252

5353
The Hadoop environment component versions associated with HDInsight cluster versions can change with updates to HDInsight. To check the Hadoop components and to verify which versions are being used for a cluster, use the Ambari REST API. The **GetComponentInformation** command retrieves information about service components. For details, see the [Apache Ambari documentation](https://github.com/apache/ambari/blob/trunk/ambari-server/docs/api/v1/index.md).
5454

@@ -99,50 +99,6 @@ The following table lists the versions of HDInsight that **aren't** available in
9999
> [!NOTE]
100100
> Highly available clusters with two head nodes are deployed by default for HDInsight version 2.1 and later. They are not available for HDInsight version 1.6 clusters.
101101
102-
## Enterprise Security Package for HDInsight
103-
104-
Enterprise Security is an optional package that you can add on your HDInsight cluster as part of create cluster workflow. The Enterprise Security Package supports:
105-
106-
- Integration with Active Directory for authentication.
107-
108-
In the past, you created HDInsight clusters with local admin user and local SSH user. The local admin user can access all the files, folders, tables, and columns. With Enterprise Security Package, you enable role-based access control by integrating HDInsight with your Active Directory. Which includes on-premises Active Directory, Azure Active Directory Domain Services. Or Active Directory on IaaS virtual machine. Domain administrator on the cluster can grant users to use their own corporate (domain) user-name and password.
109-
110-
For more information, see:
111-
112-
- [An introduction to Apache Hadoop security with domain-joined HDInsight clusters](./domain-joined/hdinsight-security-overview.md)
113-
- [Plan Azure domain-joined Apache Hadoop clusters in HDInsight](./domain-joined/apache-domain-joined-architecture.md)
114-
- [Configure domain-joined sandbox environment](./domain-joined/apache-domain-joined-configure.md)
115-
- [Configure Domain-joined HDInsight clusters using Azure Active Directory Domain Services](./domain-joined/apache-domain-joined-configure-using-azure-adds.md)
116-
117-
- Authorization for data
118-
119-
- Integration with Apache Ranger for authorization for Hive, Spark SQL, and Yarn Queues.
120-
- You can set access control on files and folders.
121-
122-
For more information, see:
123-
124-
- [Configure Apache Hive policies in Domain-joined HDInsight](./domain-joined/apache-domain-joined-run-hive.md)
125-
126-
- View the audit logs to monitor accesses and the configured policies.
127-
128-
### Supported cluster types
129-
130-
Currently, only the following cluster types support the Enterprise Security Package:
131-
132-
- Hadoop (HDInsight 3.6 only)
133-
- Spark
134-
- Kafka
135-
- HBase
136-
- Interactive Query
137-
138-
### Support for Azure Data Lake Storage
139-
140-
The Enterprise Security Package supports using Azure Data Lake Storage as both the primary storage and the add-on storage.
141-
142-
### Pricing and service level agreement (SLA)
143-
144-
For information on pricing and SLA for the Enterprise Security Package, see [HDInsight pricing](https://azure.microsoft.com/pricing/details/hdinsight/).
145-
146102
## Service level agreement for HDInsight cluster versions
147103

148104
The service level agreement (SLA) is defined as a _support window_. Support window is the time period an HDInsight version is supported by `Microsoft Customer Service and Support`. If the version has a passed _support expiration date_, the HDInsight cluster is outside the support window. Support expiration for HDInsight version X (after a newer X+1 version is available) is the later:
@@ -161,3 +117,4 @@ For more information on which virtual machine SKUs to select for your cluster, s
161117
- [Cluster setup for Apache Hadoop, Spark, and more on HDInsight](hdinsight-hadoop-provision-linux-clusters.md)
162118
- [Work in Apache Hadoop on HDInsight from a Windows PC](hdinsight-hadoop-windows-tools.md)
163119
- [Hortonworks release notes associated with Azure HDInsight versions](./hortonworks-release-notes.md)
120+
- [Enterprise Security Package](./enterprise-security-package.md)

articles/hdinsight/hdinsight-hadoop-create-linux-clusters-azure-cli.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ Azure CLI. If you haven't installed the Azure CLI, see [Install the Azure CLI](h
4444
|`--workernode-count`| The number of worker nodes in the cluster. This article uses the variable `clusterSizeInNodes` as the value passed to `--workernode-count`. |
4545
|`--version`| The HDInsight cluster version. This article uses the variable `clusterVersion` as the value passed to `--version`. See also: [Supported HDInsight versions](./hdinsight-component-versioning.md#supported-hdinsight-versions).|
4646
|`--type`| Type of HDInsight cluster, like: hadoop, interactivehive, hbase, kafka, storm, spark, rserver, mlservices. This article uses the variable `clusterType` as the value passed to `--type`. See also: [Cluster types and configuration](./hdinsight-hadoop-provision-linux-clusters.md#cluster-type).|
47-
|`--component-version`|The versions of various Hadoop components, in space-separated versions in 'component=version' format. This article uses the variable `componentVersion` as the value passed to `--component-version`. See also: [Hadoop components](./hdinsight-component-versioning.md#apache-hadoop-components-available-with-different-hdinsight-versions).|
47+
|`--component-version`|The versions of various Hadoop components, in space-separated versions in 'component=version' format. This article uses the variable `componentVersion` as the value passed to `--component-version`. See also: [Hadoop components](./hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions).|
4848
4949
Replace `RESOURCEGROUPNAME`, `LOCATION`, `CLUSTERNAME`, `STORAGEACCOUNTNAME`, and `PASSWORD` with the desired values. Change values for the other variables as desired. Then enter the CLI commands.
5050

0 commit comments

Comments
 (0)