Skip to content

Commit 53ec521

Browse files
committed
fla
Signed-off-by: Mayank Mishra <mayank31398@gmail.com>
1 parent b8775b9 commit 53ec521

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

lm_engine/hf_models/config/sequence_mixer.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -119,7 +119,7 @@ class _GatedDeltaNetArgs(BaseArgs):
119119
head_dim: int = 256
120120
v_head_dim: int = 512
121121
num_heads: int = 6
122-
num_v_heads: int | None = None
122+
num_v_heads: int = 6
123123
mode: str = "chunk"
124124
use_gate: bool = True
125125
allow_neg_eigval: bool = False

0 commit comments

Comments
 (0)