Skip to content

Commit 6c08613

Browse files
authored
Merge pull request #96792 from dagiro/freshness63
freshness63
2 parents 2861c56 + f0c462c commit 6c08613

File tree

1 file changed

+19
-31
lines changed

1 file changed

+19
-31
lines changed

articles/hdinsight/hdinsight-hadoop-customize-cluster-bootstrap.md

Lines changed: 19 additions & 31 deletions
Original file line numberDiff line numberDiff line change
@@ -5,9 +5,9 @@ author: hrasheed-msft
55
ms.author: hrasheed
66
ms.reviewer: jasonh
77
ms.service: hdinsight
8-
ms.custom: hdinsightactive
98
ms.topic: conceptual
10-
ms.date: 04/19/2019
9+
ms.custom: hdinsightactive
10+
ms.date: 11/21/2019
1111
---
1212

1313
# Customize HDInsight clusters using Bootstrap
@@ -43,7 +43,7 @@ For information on installing additional components on HDInsight cluster during
4343

4444
## Prerequisites
4545

46-
* If using PowerShell, you will need the [Az Module](https://docs.microsoft.com/powershell/azure/overview).
46+
* If using PowerShell, you'll need the [Az Module](https://docs.microsoft.com/powershell/azure/overview).
4747

4848
## Use Azure PowerShell
4949

@@ -54,7 +54,7 @@ The following PowerShell code customizes an [Apache Hive](https://hive.apache.or
5454
5555
```powershell
5656
# hive-site.xml configuration
57-
$hiveConfigValues = @{ "hive.metastore.client.socket.timeout"="90" }
57+
$hiveConfigValues = @{ "hive.metastore.client.socket.timeout"="90s" }
5858
5959
$config = New-AzHDInsightClusterConfig `
6060
| Set-AzHDInsightDefaultStorage `
@@ -80,17 +80,10 @@ A complete working PowerShell script can be found in [Appendix](#appendix-powers
8080

8181
**To verify the change:**
8282

83-
1. Sign on to the [Azure portal](https://portal.azure.com).
84-
2. From the left menu, click **HDInsight clusters**. If you don't see it, click **All services** first.
85-
3. Click the cluster you just created using the PowerShell script.
86-
4. Click **Dashboard** from the top of the blade to open the Ambari UI.
87-
5. Click **Hive** from the left menu.
88-
6. Click **HiveServer2** from **Summary**.
89-
7. Click the **Configs** tab.
90-
8. Click **Hive** from the left menu.
91-
9. Click the **Advanced** tab.
92-
10. Scroll down and then expand **Advanced hive-site**.
93-
11. Look for **hive.metastore.client.socket.timeout** in the section.
83+
1. Navigate to `https://CLUSTERNAME.azurehdinsight.net/` where `CLUSTERNAME` is the name of your cluster.
84+
1. From the left menu, navigate to **Hive** > **Configs** > **Advanced**.
85+
1. Expand **Advanced hive-site**.
86+
1. Locate **hive.metastore.client.socket.timeout** and confirm the value is **90s**.
9487

9588
Some more samples on customizing other configuration files:
9689

@@ -109,9 +102,11 @@ $OozieConfigValues = @{ "oozie.service.coord.normal.default.timeout"="150" } #
109102
```
110103

111104
## Use .NET SDK
105+
112106
See [Create Linux-based clusters in HDInsight using the .NET SDK](hdinsight-hadoop-create-linux-clusters-dotnet-sdk.md#use-bootstrap).
113107

114108
## Use Resource Manager template
109+
115110
You can use bootstrap in Resource Manager template:
116111

117112
```json
@@ -128,38 +123,29 @@ You can use bootstrap in Resource Manager template:
128123

129124
## See also
130125

131-
* [Create Apache Hadoop clusters in HDInsight][hdinsight-provision-cluster] provides instructions on how to create an HDInsight cluster by using other custom options.
132-
* [Develop Script Action scripts for HDInsight][hdinsight-write-script]
133-
* [Install and use Apache Spark on HDInsight clusters][hdinsight-install-spark]
126+
* [Create Apache Hadoop clusters in HDInsight](hdinsight-hadoop-provision-linux-clusters.md) provides instructions on how to create an HDInsight cluster by using other custom options.
127+
* [Develop Script Action scripts for HDInsight](hdinsight-hadoop-script-actions-linux.md)
128+
* [Install and use Apache Spark on HDInsight clusters](spark/apache-spark-jupyter-spark-sql-use-portal.md)
134129
* [Install and use Apache Giraph on HDInsight clusters](hdinsight-hadoop-giraph-install.md).
135130

136-
[hdinsight-install-spark]: hdinsight-hadoop-spark-install.md
137-
[hdinsight-write-script]: hdinsight-hadoop-script-actions-linux.md
138-
[hdinsight-provision-cluster]: hdinsight-hadoop-provision-linux-clusters.md
139-
[powershell-install-configure]: /powershell/azureps-cmdlets-docs
140-
[img-hdi-cluster-states]: ./media/hdinsight-hadoop-customize-cluster/HDI-Cluster-state.png "Stages during cluster creation"
141-
142131
## Appendix: PowerShell sample
143132

144133
This PowerShell script creates an HDInsight cluster and customizes a Hive setting. Be sure to enter values for `$nameToken`, `$httpPassword`, and `$sshPassword`.
145134

146-
> [!WARNING]
147-
> Storage account kind `BlobStorage` cannot be used for HDInsight clusters.
148-
149135
```powershell
150136
####################################
151137
# Set these variables
152138
####################################
153139
#region - used for creating Azure service names
154-
$nameToken = "<ENTER AN ALIAS>"
140+
$nameToken = "<ENTER AN ALIAS>"
155141
#endregion
156142
157143
#region - cluster user accounts
158144
$httpUserName = "admin" #HDInsight cluster username
159-
$httpPassword = '<ENTER A PASSWORD>'
145+
$httpPassword = '<ENTER A PASSWORD>'
160146
161147
$sshUserName = "sshuser" #HDInsight ssh user name
162-
$sshPassword = '<ENTER A PASSWORD>'
148+
$sshPassword = '<ENTER A PASSWORD>'
163149
#endregion
164150
165151
####################################
@@ -211,6 +197,8 @@ New-AzStorageAccount `
211197
-Kind StorageV2 `
212198
-EnableHttpsTrafficOnly 1
213199
200+
# Note: Storage account kind BlobStorage cannot be used as primary storage.
201+
214202
$defaultStorageAccountKey = (Get-AzStorageAccountKey `
215203
-ResourceGroupName $resourceGroupName `
216204
-Name $defaultStorageAccountName)[0].Value
@@ -226,7 +214,7 @@ New-AzStorageContainer `
226214
####################################
227215
# Create a configuration object
228216
####################################
229-
$hiveConfigValues = @{"hive.metastore.client.socket.timeout"="90"}
217+
$hiveConfigValues = @{"hive.metastore.client.socket.timeout"="90s"}
230218
231219
$config = New-AzHDInsightClusterConfig `
232220
| Set-AzHDInsightDefaultStorage `

0 commit comments

Comments
 (0)