We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent b8b5007 commit 36222c4Copy full SHA for 36222c4
modelopt/torch/speculative/eagle/default_config.py
@@ -47,5 +47,5 @@
47
"use_mtp_layernorm": False,
48
"parallel_draft_step": 1,
49
"has_lm_head": False,
50
- "head_dim": 64,
+ "head_dim": 128,
51
}
0 commit comments