Skip to content

Commit 36222c4

Browse files
committed
update default headdim to 128
Signed-off-by: h-guo18 <[email protected]>
1 parent b8b5007 commit 36222c4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

modelopt/torch/speculative/eagle/default_config.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,5 +47,5 @@
4747
"use_mtp_layernorm": False,
4848
"parallel_draft_step": 1,
4949
"has_lm_head": False,
50-
"head_dim": 64,
50+
"head_dim": 128,
5151
}

0 commit comments

Comments
 (0)