Skip to content

Commit 662cd12

Browse files
authored
Removed HDI 3.6 mentions as it is retired
Removed HDI 3.6 mentions as it is retired
1 parent 5b4a9d0 commit 662cd12

File tree

1 file changed

+4
-4
lines changed

1 file changed

+4
-4
lines changed

articles/hdinsight/interactive-query/hive-llap-sizing-guide.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ ms.service: hdinsight
55
ms.topic: troubleshooting
66
author: reachnijel
77
ms.author: nijelsf
8-
ms.date: 07/19/2022
8+
ms.date: 11/23/2022
99
---
1010

1111
# Azure HDInsight Interactive Query Cluster (Hive LLAP) sizing guide
@@ -125,7 +125,7 @@ The LLAP daemon container size is calculated as follows;
125125
**LLAP daemon container size = (Total memory for LLAP queue on a workernode) – (Tez AM memory per node) - (Service Master container size)**
126126
There is only one Service Master (Application Master for LLAP service) on the cluster spawned on one of the worker nodes. For calculation purpose, we consider one service master per worker node.
127127
For D14 v2 worker node, HDI 4.0 - the recommended value is (85 GB - 4 GB - 1 GB)) = **80 GB**
128-
(For HDI 3.6, recommended value is **79 GB** because you should reserve additional ~2 GB for slider AM.)
128+
129129

130130
#### **8. Determining number of executors per LLAP daemon**
131131
Configuration: ***hive.llap.daemon.num.executors***, ***hive.llap.io.threadpool.size***
@@ -171,15 +171,15 @@ Setting *hive.llap.io.allocator.mmap* = true will enable SSD caching.
171171
When SSD cache is enabled, some portion of the memory will be used to store metadata for the SSD cache. The metadata is stored in memory and it's expected to be ~8% of SSD cache size.
172172
SSD Cache in-memory metadata size = LLAP daemon container size - (Head room + Heap size)
173173
For D14 v2, with HDI 4.0, SSD cache in-memory metadata size = 80 GB - (4 GB + 57 GB) = **19 GB**
174-
For D14 v2, with HDI 3.6, SSD cache in-memory metadata size = 79 GB - (4 GB + 57 GB) = **18 GB**
174+
175175

176176
Given the size of available memory for storing SSD cache metadata, we can calculate the size of SSD cache that can be supported.
177177
Size of in-memory metadata for SSD cache = LLAP daemon container size - (Head room + Heap size)
178178
= 19 GB
179179
Size of SSD cache = size of in-memory metadata for SSD cache(19 GB) / 0.08 (8 percent)
180180

181181
For D14 v2 and HDI 4.0, the recommended SSD cache size = 19 GB / 0.08 ~= **237 GB**
182-
For D14 v2 and HDI 3.6, the recommended SSD cache size = 18 GB / 0.08 ~= **225 GB**
182+
183183

184184
#### **10. Adjusting Map Join memory**
185185
Configuration: ***hive.auto.convert.join.noconditionaltask.size***

0 commit comments

Comments
 (0)