Skip to content

Check if ffn_up and ffn_gate are of the same type before using fmoe#495

Open
ikawrakow wants to merge 2 commits intomainfrom
ik/check_up_gate_fmoe
Open

Check if ffn_up and ffn_gate are of the same type before using fmoe#495
ikawrakow wants to merge 2 commits intomainfrom
ik/check_up_gate_fmoe

Commits

Commits on Jun 6, 2025