Skip to content

Commit f9476b3

Browse files
committed
ts_ambari9
1 parent 4353e9d commit f9476b3

File tree

2 files changed

+78
-1
lines changed

2 files changed

+78
-1
lines changed

articles/hdinsight/TOC.yml

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,9 @@
3838
- name: Apache Hadoop components on HDInsight
3939
href: ./hdinsight-component-versioning.md
4040
- name: High availability components
41-
href: ./hdinsight-high-availability-components.md
41+
href: ./hdinsight-high-availability-components.md
42+
- name: Apache Ambari in Azure HDInsight
43+
href: ./apache-ambari-usage.md
4244
- name: Machine learning in HDInsight
4345
href: ./hdinsight-machine-learning-overview.md
4446
- name: Streaming at scale in HDInsight
Lines changed: 75 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,75 @@
1+
---
2+
title: Apache Ambari usage in Azure HDInsight
3+
description: Discussion of how Apache Ambari is used in Azure HDInsight.
4+
author: hrasheed-msft
5+
ms.author: hrasheed
6+
ms.reviewer: jasonh
7+
ms.service: hdinsight
8+
ms.topic: conceptual
9+
ms.date: 02/05/2020
10+
---
11+
12+
# Apache Ambari usage in Azure HDInsight
13+
14+
HDInsight uses Apache Ambari for cluster deployment and management. Ambari agents run on every node (headnode, worker node, zookeeper, and edgenode if exists). Ambari server runs only on headnode (hn0 or hn1). Only one instance of Ambari server shall run at one time. This is controlled by HDInsight failover controller. When one of the headnodes is down for reboot or maintenance, the other headnode will become active and Ambari server on the second headnode will be started.
15+
16+
All cluster configuration should be done through the [Ambari UI](./hdinsight-hadoop-manage-ambari.md), any local change will be overwritten when the node is restarted.
17+
18+
## Failover controller services
19+
20+
The HDInsight failover controller is also responsible for updating the IP address of headnode host, which points to the current active head node. All Ambari agents are configured to report its state and heartbeat to headnode host. The failover controller is a set of services running on every node in the cluster, if they aren't running, the headnode failover may not work correctly and you'll end up with HTTP 502 when trying to access Ambari server.
21+
22+
To check which headnode is active, one way is to ssh to one of the nodes in the cluster, then run `ping headnodehost` and compare the IP with that of the two headnodes.
23+
24+
If failover controller services aren't running, headnode failover may not happen correctly, which may end up not running Ambari server. To check if failover controller services are running, execute:
25+
26+
```bash
27+
ps -ef | grep failover
28+
```
29+
30+
## Logs
31+
32+
On the active headnode, you can check the Ambari server logs at:
33+
34+
```
35+
/var/log/ambari-server/ambari-server.log
36+
/var/log/ambari-server/ambari-server-check-database.log
37+
```
38+
39+
On any node in the cluster, you can check the Ambari agent logs at:
40+
41+
```bash
42+
/var/log/ambari-agent/ambari-agent.log
43+
```
44+
45+
## Service start sequences
46+
47+
This is the sequence of service start at boot time:
48+
49+
1. Hdinsight-agent starts failover controller services.
50+
1. Failover controller services start Ambari agent on every node and Ambari server on active headnode.
51+
52+
## Ambari Database
53+
54+
HDInsight creates SQL Azure Database under the hood to serve as the database for Ambari server. The default [service tier is S0](../sql-database/sql-database-elastic-pool-scale.md).
55+
56+
For any cluster with worker node count bigger than 16 when creating the cluster, S2 is the database service tier.
57+
58+
## Takeaway points
59+
60+
Never manually start/stop ambari-server or ambari-agent services, unless you're trying to restart the service to work around an issue. To force a failover, you can reboot the active headnode.
61+
62+
Never manually modify any configuration files on any cluster node, let Ambari UI do the job for you.
63+
64+
## Next steps
65+
66+
* [Manage HDInsight clusters by using the Apache Ambari Web UI](hdinsight-hadoop-manage-ambari.md)
67+
* [Manage HDInsight clusters by using the Apache Ambari REST API](hdinsight-hadoop-manage-ambari-rest-api.md)
68+
69+
If you didn't see your problem or are unable to solve your issue, visit one of the following channels for more support:
70+
71+
* Get answers from Azure experts through [Azure Community Support](https://azure.microsoft.com/support/community/).
72+
73+
* Connect with [@AzureSupport](https://twitter.com/azuresupport) - the official Microsoft Azure account for improving customer experience. Connecting the Azure community to the right resources: answers, support, and experts.
74+
75+
* If you need more help, you can submit a support request from the [Azure portal](https://portal.azure.com/?#blade/Microsoft_Azure_Support/HelpAndSupportBlade/). Select **Support** from the menu bar or open the **Help + support** hub. For more detailed information, review [How to create an Azure support request](https://docs.microsoft.com/azure/azure-supportability/how-to-create-azure-support-request). Access to Subscription Management and billing support is included with your Microsoft Azure subscription, and Technical Support is provided through one of the [Azure Support Plans](https://azure.microsoft.com/support/plans/).

0 commit comments

Comments
 (0)