Skip to content

Commit 8aed808

Browse files
fix
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
1 parent 94aecac commit 8aed808

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

lightllm/models/qwen3_moe/model.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,4 +30,4 @@ def _init_config(self):
3030

3131
def _init_custom(self):
3232
super()._init_custom()
33-
dist_group_manager.new_deepep_group(256, self.config["hidden_size"])
33+
dist_group_manager.new_deepep_group(self.config["num_experts"], self.config["hidden_size"])

0 commit comments

Comments
 (0)