You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight/domain-joined/apache-domain-joined-configure-using-azure-adds.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,7 +11,7 @@ ms.date: 09/06/2024
11
11
12
12
This article provides a summary and overview of the process of creating and configuring an HDInsight cluster integrated with Microsoft Entra ID. This integration relies on a HDInsight feature called Enterprise Security Package (ESP), Microsoft Entra Domain Services and your preexisting on-premises Active Directory.
13
13
14
-
For a detailed, step-by-step tutorial on setting up and configuring a domain in Azure and creating an ESP enabled cluster and then syncing on-premises users, see [Create, and configure Enterprise Security Package clusters in Azure HDInsight](apache-domain-joined-create-configure-enterprise-security-cluster.md).
14
+
For a detailed, step-by-step tutorial on setting up and configuring a domain in Azure and creating an ESP enabled cluster and then syncing on-premises users, see [Create and configure Enterprise Security Package clusters in Azure HDInsight](apache-domain-joined-create-configure-enterprise-security-cluster.md).
15
15
16
16
## Background
17
17
@@ -30,7 +30,7 @@ There are a few prerequisites to complete before you can create an ESP-enabled H
30
30
- Create and authorize a managed identity.
31
31
- Complete Networking setup for DNS and related issues.
32
32
33
-
Each of this item is discussed in details. For a walkthrough of completing all of these steps, see [Create and configure Enterprise Security Package clusters in Azure HDInsight](apache-domain-joined-create-configure-enterprise-security-cluster.md).
33
+
Each of these items are discussed in detail. For a walkthrough of completing all of these steps, see [Create and configure Enterprise Security Package clusters in Azure HDInsight](apache-domain-joined-create-configure-enterprise-security-cluster.md).
### Check Microsoft Entra Domain Services health status
68
68
69
-
View the health status of Microsoft Entra Domain Services by selecting `Health` in the `Manage` category. Make sure the status of Microsoft Entra Domain Services is green (running) and the synchronization is complete.
69
+
View the health status of Microsoft Entra Domain Services by selecting **Health** in the **Manage** category. Make sure the status of Microsoft Entra Domain Services is green (running) and the synchronization is complete.
@@ -95,7 +95,7 @@ For example, the Microsoft Entra Domain Services admin can assign this role to t
95
95
> [!NOTE]
96
96
> Microsoft Entra Domain Services must be deployed in an Azure Resource Manager-based virtual network. Classic virtual networks are not supported for Microsoft Entra Domain Services. For more information, see [Enable Microsoft Entra Domain Services by using the Azure portal](../../active-directory-domain-services/tutorial-create-instance-advanced.md#create-and-configure-the-virtual-network).
97
97
98
-
Enable Microsoft Entra Domain Services. Then a local Domain Name System (DNS) server runs on the Active Directory virtual machines (VMs). Configure your Microsoft Entra Domain Services virtual network to use these custom DNS servers. To locate the right IP addresses, select `Properties` in the `Manage` category and look under **IP ADDRESS ON VIRTUAL NETWORK**.
98
+
Enable Microsoft Entra Domain Services. Then a local Domain Name System (DNS) server runs on the Active Directory virtual machines (VMs). Configure your Microsoft Entra Domain Services virtual network to use these custom DNS servers. To locate the right IP addresses, select **Properties** in the **Manage** category and look under **IP ADDRESS ON VIRTUAL NETWORK**.
99
99
100
100
:::image type="content" source="./media/apache-domain-joined-configure-using-azure-adds/hdinsight-aadds-dns1.png" alt-text="Locate IP addresses for local DNS servers." border="true":::
Copy file name to clipboardExpand all lines: articles/hdinsight/hadoop/apache-hadoop-deep-dive-advanced-analytics.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -57,7 +57,7 @@ HDInsight has several machine learning options for an advanced analytics workflo
57
57
There are three scalable machine learning libraries that bring algorithmic modeling capabilities to this distributed environment:
58
58
59
59
*[**MLlib**](https://spark.apache.org/docs/latest/ml-guide.html) - MLlib contains the original API built on top of Spark RDDs.
60
-
* SparkML- SparkML is a newer package that provides a higher-level API built on top of Spark DataFrames for constructing ML pipelines.
60
+
***SparkML**- SparkML is a newer package that provides a higher-level API built on top of Spark DataFrames for constructing ML pipelines.
61
61
*[**MMLSpark**](https://github.com/Azure/mmlspark) - The Microsoft Machine Learning library for Apache Spark (MMLSpark) is designed to make data scientists more productive on Spark, to increase the rate of experimentation, and to leverage cutting-edge machine learning techniques, including deep learning, on large datasets. The MMLSpark library simplifies common modeling tasks for building models in PySpark.
In the **Upload New File** dialog box, under **File name**, select **Browse**. In the **Upload Blob** dialog box, go to the `bin\debug` folder for the *mapper* project, and then choose the *mapper.exe* file. Finally, select **Open** and then **OK** to complete the upload.
160
+
In the **Upload New File** dialog box, under **File name**, select **Browse**. In the **Upload Blob** dialog box, go to the *bin\debug* folder for the *mapper* project, and then choose the *mapper.exe* file. Finally, select **Open** and then **OK** to complete the upload.
161
161
162
162
* For **Azure Data Lake Storage**, right-click an empty area in the file listing, and then select **Upload**. Finally, select the *mapper.exe* file and then select **Open**.
Copy file name to clipboardExpand all lines: articles/hdinsight/hadoop/apache-hadoop-use-hive-curl.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -178,7 +178,7 @@ $clusterName
178
178
179
179
1. Once the state of the job has changed to **SUCCEEDED**, you can retrieve the results of the job from Azure Blob storage. The `statusdir` parameter passed with the query contains the location of the output file;in this case, `/example/rest`. This address stores the output in the `example/curl` directory in the clusters default storage.
180
180
181
-
You can list and download these files by using the [Azure CLI](/cli/azure/install-azure-cli). For more information, see [Use Azure CLI with Azure Storage](../../storage/blobs/storage-quickstart-blobs-cli.md) document.
181
+
You can list and download these files by using the [Azure CLI](/cli/azure/install-azure-cli). For more information, see [Use Azure CLI with Azure Storage](../../storage/blobs/storage-quickstart-blobs-cli.md).
Copy file name to clipboardExpand all lines: articles/hdinsight/hadoop/troubleshoot-invalidnetworkconfigurationerrorcode-cluster-creation-fails.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -145,7 +145,7 @@ Another cause for this `InvalidNetworkConfigurationErrorCode` error code could b
145
145
146
146
### Resolution
147
147
148
-
Use the valid parameters for `Get-AzVirtualNetwork` as documented in the [Az PowerShell module PowerShell SDK](/powershell/module/az.network/get-azvirtualnetwork)
148
+
Use the valid parameters for `Get-AzVirtualNetwork` as documented in the [Az PowerShell SDK](/powershell/module/az.network/get-azvirtualnetwork)
Copy file name to clipboardExpand all lines: articles/hdinsight/hbase/apache-hbase-advisor.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -41,7 +41,7 @@ To optimize the recent data in cache, consider the following configuration setti
41
41
42
42
## Optimize the flush queue
43
43
44
-
This advisory indicates that HBase flushes may need to tune. The current configuration for flush handlers may not be high enough to handle with write traffic that may lead to slow down of flushes.
44
+
This advisory indicates that HBase flushes may need tuning. The current configuration for flush handlers may not be high enough to handle with write traffic that may lead to slow down of flushes.
45
45
46
46
In the region server UI, notice if the flush queue grows beyond 100. This threshold indicates the flushes are slow and you may have to tune the `hbase.hstore.flusher.count` configuration. By default, the value is 2. Ensure that the max flusher threads don't increase beyond 6.
Copy file name to clipboardExpand all lines: articles/hdinsight/hbase/apache-hbase-migrate-new-version.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -43,7 +43,7 @@ To upgrade your Apache HBase cluster on Azure HDInsight, complete the following
43
43
44
44
Prepare the source cluster:
45
45
1. Stop data ingestion.
46
-
1. Flush `memstore` data.
46
+
1. Flush memstore data.
47
47
1. Stop HBase from Ambari.
48
48
1. For clusters with accelerated writes, back up the Write Ahead Log (WAL) directory.
49
49
@@ -71,11 +71,11 @@ Use these detailed steps and commands to migrate your Apache HBase cluster.
71
71
72
72
1. Flush the source HBase cluster you're upgrading.
73
73
74
-
HBase writes incoming data to an in-memory store called a *`memstore`*. After the `memstore` reaches a certain size, HBase flushes it to disk for long-term storage in the cluster's storage account. Deleting the source cluster after an upgrade also deletes any data in the `memstore`s. To retain the data, manually flush each table's `memstore` to disk before upgrading.
74
+
HBase writes incoming data to an in-memory store called a *memstore*. After the memstore reaches a certain size, HBase flushes it to disk for long-term storage in the cluster's storage account. Deleting the source cluster after an upgrade also deletes any data in the memstores. To retain the data, manually flush each table's memstore to disk before upgrading.
75
75
76
-
You can flush the `memstore` data by running the [flush_all_tables.sh](https://github.com/Azure/hbase-utils/blob/master/scripts/flush_all_tables.sh) script from the [Azure hbase-utils GitHub repository](https://github.com/Azure/hbase-utils/).
76
+
You can flush the memstore data by running the [flush_all_tables.sh](https://github.com/Azure/hbase-utils/blob/master/scripts/flush_all_tables.sh) script from the [Azure hbase-utils GitHub repository](https://github.com/Azure/hbase-utils/).
77
77
78
-
You can also flush `memstore` data by running the following HBase shell command from the HDInsight cluster:
78
+
You can also flush memstore data by running the following HBase shell command from the HDInsight cluster:
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-create-virtual-network.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -23,7 +23,7 @@ Other prerequisites for the samples in this article include the following items:
23
23
* If you want to use Azure CLI and haven't yet installed it, see [Install the Azure CLI](/cli/azure/install-azure-cli).
24
24
25
25
> [!IMPORTANT]
26
-
> If you are looking for step by step guidance on connecting HDInsight to your on-premises network using an Azure Virtual Network, see [How to connect HDInsight to your on-premises network](connect-on-premises-network.md) document.
26
+
> If you are looking for step by step guidance on connecting HDInsight to your on-premises network using an Azure Virtual Network, see [How to connect HDInsight to your on-premises network](connect-on-premises-network.md).
27
27
28
28
## <aid="hdinsight-nsg"></a>Example: network security groups with HDInsight
0 commit comments