Skip to content

Commit b164aa1

Browse files
committed
Fix array
1 parent 4fe5c96 commit b164aa1

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4197,6 +4197,7 @@ def set_gguf_parameters(self):
41974197
is_mamba = (i % mamba_step) != (mamba_step // 2)
41984198
if is_mamba:
41994199
num_key_value_heads.append(0)
4200+
num_attention_heads.append(0)
42004201
else:
42014202
num_key_value_heads.append(hparams.get("num_key_value_heads", 4))
42024203
num_attention_heads.append(hparams.get("num_attention_heads", 32))

0 commit comments

Comments
 (0)