Skip to content

Commit 5f9e4e1

Browse files
committed
add attn_k_norm and attn_q_norm tensors for GLM-4.5
1 parent dbe9f10 commit 5f9e4e1

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

gguf-py/gguf/constants.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2549,7 +2549,9 @@ class MODEL_TENSOR(IntEnum):
25492549
MODEL_TENSOR.OUTPUT,
25502550
MODEL_TENSOR.ATTN_NORM,
25512551
MODEL_TENSOR.ATTN_Q,
2552+
MODEL_TENSOR.ATTN_Q_NORM, # not used in the 106B.A12B model
25522553
MODEL_TENSOR.ATTN_K,
2554+
MODEL_TENSOR.ATTN_K_NORM, # not used in the 106B.A12B model
25532555
MODEL_TENSOR.ATTN_V,
25542556
MODEL_TENSOR.ATTN_OUT,
25552557
MODEL_TENSOR.FFN_NORM,

0 commit comments

Comments
 (0)