You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: Enterprise Security Package for Azure HDInsight
3
+
description: Learn the Enterprise Security Package components and versions in Azure HDInsight.
4
+
author: hrasheed-msft
5
+
ms.author: hrasheed
6
+
ms.reviewer: jasonh
7
+
ms.service: hdinsight
8
+
ms.topic: conceptual
9
+
ms.date: 05/08/2020
10
+
---
11
+
12
+
# Enterprise Security Package for Azure HDInsight
13
+
14
+
Enterprise Security is an optional package that you can add on your HDInsight cluster as part of create cluster workflow. The Enterprise Security Package supports:
15
+
16
+
* Integration with Active Directory for authentication.
17
+
18
+
In the past, you created HDInsight clusters with local admin user and local SSH user. The local admin user can access all the files, folders, tables, and columns. With Enterprise Security Package, you enable role-based access control by integrating HDInsight with your Active Directory. Which includes on-premises Active Directory, Azure Active Directory Domain Services. Or Active Directory on IaaS virtual machine. Domain administrator on the cluster can grant users to use their own corporate (domain) user-name and password.
19
+
20
+
For more information, see:
21
+
22
+
*[An introduction to Apache Hadoop security with domain-joined HDInsight clusters](./domain-joined/hdinsight-security-overview.md)
23
+
24
+
*[Plan Azure domain-joined Apache Hadoop clusters in HDInsight](./domain-joined/apache-domain-joined-architecture.md)
*[Configure Domain-joined HDInsight clusters using Azure Active Directory Domain Services](./domain-joined/apache-domain-joined-configure-using-azure-adds.md)
29
+
30
+
* Authorization for data
31
+
32
+
* Integration with Apache Ranger for authorization for Hive, Spark SQL, and Yarn Queues.
33
+
* You can set access control on files and folders.
34
+
35
+
For more information, see [Configure Apache Hive policies in Domain-joined HDInsight](./domain-joined/apache-domain-joined-run-hive.md)
36
+
37
+
* View the audit logs to monitor accesses and the configured policies.
38
+
39
+
## Supported cluster types
40
+
41
+
Currently, only the following cluster types support the Enterprise Security Package:
42
+
43
+
* Hadoop (HDInsight 3.6 only)
44
+
* Spark
45
+
* Kafka
46
+
* HBase
47
+
* Interactive Query
48
+
49
+
## Support for Azure Data Lake Storage
50
+
51
+
The Enterprise Security Package supports using Azure Data Lake Storage as both the primary storage and the add-on storage.
52
+
53
+
## Pricing and service level agreement (SLA)
54
+
55
+
For information on pricing and SLA for the Enterprise Security Package, see [HDInsight pricing](https://azure.microsoft.com/pricing/details/hdinsight/).
56
+
57
+
## Next steps
58
+
59
+
*[Cluster setup for Apache Hadoop, Spark, and more on HDInsight](hdinsight-hadoop-provision-linux-clusters.md)
60
+
*[Work in Apache Hadoop on HDInsight from a Windows PC](hdinsight-hadoop-windows-tools.md)
61
+
*[Hortonworks release notes associated with Azure HDInsight versions](./hortonworks-release-notes.md)
62
+
*[Apache components on HDInsight](./hdinsight-component-versioning.md)
Copy file name to clipboardExpand all lines: articles/hdinsight/hadoop/apache-hadoop-dotnet-csharp-mapreduce-streaming.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,7 +18,7 @@ Apache Hadoop streaming allows you to run MapReduce jobs using a script or execu
18
18
19
19
## .NET on HDInsight
20
20
21
-
HDInsight clusters use [Mono (https://mono-project.com)](https://mono-project.com) to run .NET applications. Mono version 4.2.1 is included with HDInsight version 3.6. For more information on the version of Mono included with HDInsight, see [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-hadoop-components-available-with-different-hdinsight-versions).
21
+
HDInsight clusters use [Mono (https://mono-project.com)](https://mono-project.com) to run .NET applications. Mono version 4.2.1 is included with HDInsight version 3.6. For more information on the version of Mono included with HDInsight, see [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions).
22
22
23
23
For more information on Mono compatibility with .NET Framework versions, see [Mono compatibility](https://www.mono-project.com/docs/about-mono/compatibility/).
Copy file name to clipboardExpand all lines: articles/hdinsight/hadoop/apache-hadoop-on-premises-migration-best-practices-infrastructure.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -71,7 +71,7 @@ Applications or components that were available in on-premises clusters but aren'
71
71
|Palantir|IaaS
72
72
|Sailpoint|Iaas
73
73
74
-
For more information, see the article [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-hadoop-components-available-with-different-hdinsight-versions)
74
+
For more information, see the article [Apache Hadoop components available with different HDInsight versions](../hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions)
75
75
76
76
## Customize HDInsight clusters using script actions
Copy file name to clipboardExpand all lines: articles/hdinsight/hadoop/hdinsight-troubleshoot-cluster-creation-fails.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -64,7 +64,7 @@ Ensure that there are no [locks on your virtual network and resource group](../.
64
64
65
65
## Unsupported component versions
66
66
67
-
Ensure that you are using a [supported version of Azure HDInsight](../hdinsight-component-versioning.md) and any [Apache Hadoop components](../hdinsight-component-versioning.md#apache-hadoop-components-available-with-different-hdinsight-versions) in your solution.
67
+
Ensure that you are using a [supported version of Azure HDInsight](../hdinsight-component-versioning.md) and any [Apache Hadoop components](../hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions) in your solution.
# What are the Apache Hadoop components and versions available with HDInsight?
13
+
# Apache components and versions available for Azure HDInsight
14
14
15
15
Learn about the [Apache Hadoop](https://hadoop.apache.org/) environment components and versions in Microsoft Azure HDInsight, and the Enterprise Security Package. Also, learn how to check Hadoop component versions in HDInsight.
16
16
17
-
## Apache Hadoop components available with different HDInsight versions
17
+
## Apache components available with different HDInsight versions
18
18
19
19
Azure HDInsight supports multiple Hadoop cluster versions that can be deployed at any time. On April 4, 2017, the default cluster version used by Azure HDInsight is 3.6.
20
20
@@ -48,7 +48,7 @@ The component versions associated with HDInsight cluster versions are listed in
48
48
> [!NOTE]
49
49
> Due to system performance considerations, support for Kafka version 0.10 was expired in March 2019.
50
50
51
-
## Check for current Hadoop component version information
51
+
## Check for current Apache component version information
52
52
53
53
The Hadoop environment component versions associated with HDInsight cluster versions can change with updates to HDInsight. To check the Hadoop components and to verify which versions are being used for a cluster, use the Ambari REST API. The **GetComponentInformation** command retrieves information about service components. For details, see the [Apache Ambari documentation](https://github.com/apache/ambari/blob/trunk/ambari-server/docs/api/v1/index.md).
54
54
@@ -99,50 +99,6 @@ The following table lists the versions of HDInsight that **aren't** available in
99
99
> [!NOTE]
100
100
> Highly available clusters with two head nodes are deployed by default for HDInsight version 2.1 and later. They are not available for HDInsight version 1.6 clusters.
101
101
102
-
## Enterprise Security Package for HDInsight
103
-
104
-
Enterprise Security is an optional package that you can add on your HDInsight cluster as part of create cluster workflow. The Enterprise Security Package supports:
105
-
106
-
- Integration with Active Directory for authentication.
107
-
108
-
In the past, you created HDInsight clusters with local admin user and local SSH user. The local admin user can access all the files, folders, tables, and columns. With Enterprise Security Package, you enable role-based access control by integrating HDInsight with your Active Directory. Which includes on-premises Active Directory, Azure Active Directory Domain Services. Or Active Directory on IaaS virtual machine. Domain administrator on the cluster can grant users to use their own corporate (domain) user-name and password.
109
-
110
-
For more information, see:
111
-
112
-
-[An introduction to Apache Hadoop security with domain-joined HDInsight clusters](./domain-joined/hdinsight-security-overview.md)
113
-
-[Plan Azure domain-joined Apache Hadoop clusters in HDInsight](./domain-joined/apache-domain-joined-architecture.md)
-[Configure Domain-joined HDInsight clusters using Azure Active Directory Domain Services](./domain-joined/apache-domain-joined-configure-using-azure-adds.md)
116
-
117
-
- Authorization for data
118
-
119
-
- Integration with Apache Ranger for authorization for Hive, Spark SQL, and Yarn Queues.
120
-
- You can set access control on files and folders.
121
-
122
-
For more information, see:
123
-
124
-
-[Configure Apache Hive policies in Domain-joined HDInsight](./domain-joined/apache-domain-joined-run-hive.md)
125
-
126
-
- View the audit logs to monitor accesses and the configured policies.
127
-
128
-
### Supported cluster types
129
-
130
-
Currently, only the following cluster types support the Enterprise Security Package:
131
-
132
-
- Hadoop (HDInsight 3.6 only)
133
-
- Spark
134
-
- Kafka
135
-
- HBase
136
-
- Interactive Query
137
-
138
-
### Support for Azure Data Lake Storage
139
-
140
-
The Enterprise Security Package supports using Azure Data Lake Storage as both the primary storage and the add-on storage.
141
-
142
-
### Pricing and service level agreement (SLA)
143
-
144
-
For information on pricing and SLA for the Enterprise Security Package, see [HDInsight pricing](https://azure.microsoft.com/pricing/details/hdinsight/).
145
-
146
102
## Service level agreement for HDInsight cluster versions
147
103
148
104
The service level agreement (SLA) is defined as a _support window_. Support window is the time period an HDInsight version is supported by `Microsoft Customer Service and Support`. If the version has a passed _support expiration date_, the HDInsight cluster is outside the support window. Support expiration for HDInsight version X (after a newer X+1 version is available) is the later:
@@ -161,3 +117,4 @@ For more information on which virtual machine SKUs to select for your cluster, s
161
117
-[Cluster setup for Apache Hadoop, Spark, and more on HDInsight](hdinsight-hadoop-provision-linux-clusters.md)
162
118
-[Work in Apache Hadoop on HDInsight from a Windows PC](hdinsight-hadoop-windows-tools.md)
163
119
-[Hortonworks release notes associated with Azure HDInsight versions](./hortonworks-release-notes.md)
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-hadoop-create-linux-clusters-azure-cli.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -44,7 +44,7 @@ Azure CLI. If you haven't installed the Azure CLI, see [Install the Azure CLI](h
44
44
|`--workernode-count`| The number of worker nodes in the cluster. This article uses the variable `clusterSizeInNodes` as the value passed to `--workernode-count`. |
45
45
|`--version`| The HDInsight cluster version. This article uses the variable `clusterVersion` as the value passed to `--version`. See also: [Supported HDInsight versions](./hdinsight-component-versioning.md#supported-hdinsight-versions).|
46
46
|`--type`| Type of HDInsight cluster, like: hadoop, interactivehive, hbase, kafka, storm, spark, rserver, mlservices. This article uses the variable `clusterType` as the value passed to `--type`. See also: [Cluster types and configuration](./hdinsight-hadoop-provision-linux-clusters.md#cluster-type).|
47
-
|`--component-version`|The versions of various Hadoop components, in space-separated versions in 'component=version' format. This article uses the variable `componentVersion` as the value passed to `--component-version`. See also: [Hadoop components](./hdinsight-component-versioning.md#apache-hadoop-components-available-with-different-hdinsight-versions).|
47
+
|`--component-version`|The versions of various Hadoop components, in space-separated versions in 'component=version' format. This article uses the variable `componentVersion` as the value passed to `--component-version`. See also: [Hadoop components](./hdinsight-component-versioning.md#apache-components-available-with-different-hdinsight-versions).|
48
48
49
49
Replace `RESOURCEGROUPNAME`, `LOCATION`, `CLUSTERNAME`, `STORAGEACCOUNTNAME`, and `PASSWORD` with the desired values. Change values for the other variables as desired. Then enter the CLI commands.
0 commit comments