Skip to content

Commit e7a0d10

Browse files
committed
HDInsight LLAP cluster sizing guide
1 parent 486f0f4 commit e7a0d10

File tree

1 file changed

+4
-3
lines changed

1 file changed

+4
-3
lines changed

articles/hdinsight/interactive-query/interactive-query-troubleshoot-llap-sizing-guide.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -99,8 +99,9 @@ Memory needed by Tez Application Masters(Tez AM) can be calculated as follows.
9999
For HDInsight Interactive cluster, by default, there is one Tez AM per worker node that acts as a query coordinator. The number of Tez AMs can be configured based on a number of concurrent queries to be served.
100100
It's recommended to have 4 GB of memory per Tez AM.
101101

102-
Tez AM memory per node = [ number of Tez AMs x Tez AM container size ]
103-
= (1 x 4 GB) = 4 GB
102+
Tez AM memory per node = [ ceil(number of Tez AMs / Number of LLAP daemon nodes) ] x [ Tez AM container size ]
103+
For D14 v2, the default configuration has four Tez AMs and four LLAP daemon nodes.
104+
Tez AM memory per node = (ceil(4/4) x 4 GB) = 4 GB
104105

105106
Total Memory available for LLAP queue per worker node can be calculated as follows:
106107
This value depends on the total amount of memory available for all YARN containers on a node(*yarn.nodemanager.resource.memory-mb*) and the percentage of capacity configured for llap queue(*yarn.scheduler.capacity.root.llap.capacity*).
@@ -178,4 +179,4 @@ For D14 v2, with 4 GB memory per executor, it's recommended to set this value to
178179
*https://community.cloudera.com/t5/Community-Articles/Demystify-Apache-Tez-Memory-Tuning-Step-by-Step/ta-p/245279*
179180
*https://community.cloudera.com/t5/Community-Articles/Map-Join-Memory-Sizing-For-LLAP/ta-p/247462*
180181
*https://community.cloudera.com/t5/Community-Articles/LLAP-a-one-page-architecture-overview/ta-p/247439*
181-
*https://community.cloudera.com/t5/Community-Articles/Hive-LLAP-deep-dive/ta-p/248893*
182+
*https://community.cloudera.c om/t5/Community-Articles/Hive-LLAP-deep-dive/ta-p/248893*

0 commit comments

Comments
 (0)