You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
LLAP daemon is run as a YARN container on each worker node. The total memory size for LLAP daemon container depends on following factors,
94
-
1. Configurations of YARN container size (yarn.scheduler.minimum-allocation-mb, yarn.scheduler.maximum-allocation-mb, yarn.nodemanager.resource.memory-mb)
95
-
2. Number of Tez AMs on a node
96
-
3. Total memory configured for all containers on a node and LLAP queue capacity
94
+
* Configurations of YARN container size (yarn.scheduler.minimum-allocation-mb, yarn.scheduler.maximum-allocation-mb, yarn.nodemanager.resource.memory-mb)
95
+
* Number of Tez AMs on a node
96
+
* Total memory configured for all containers on a node and LLAP queue capacity
97
97
98
98
Memory needed by Tez Application Masters(Tez AM) can be calculated as follows.
99
99
For HDInsight Interactive cluster, by default, there is one Tez AM per worker node that acts as a query coordinator. The number of Tez AMs can be configured based on a number of concurrent queries to be served.
@@ -134,10 +134,10 @@ For D14 v2, the recommended value is **12**.
134
134
Configuration: ***hive.llap.io.memory.size***
135
135
136
136
LLAP daemon container memory consists of following components;
137
-
1. Head room
138
-
2. Heap memory used by executors (Xmx)
139
-
3. In-memory cache per daemon (its off-heap memory size, not applicable when SSD cache is enabled)
140
-
4. In-memory cache metadata size (applicable only when SSD cache is enabled)
137
+
* Head room
138
+
* Heap memory used by executors (Xmx)
139
+
* In-memory cache per daemon (its off-heap memory size, not applicable when SSD cache is enabled)
140
+
* In-memory cache metadata size (applicable only when SSD cache is enabled)
141
141
142
142
**Headroom size**:
143
143
This size indicates a portion of off-heap memory used for Java VM overhead (metaspace, threads stack, gc data structures, etc.). Generally, this overhead is about 6% of the heap size (Xmx). To be on the safer side, this value can be calculated as 6% of total LLAP daemon memory size.
0 commit comments