[Unified MoE]: Add Unified MoE Interface with EP Support#2702

Open

hushenwei2000 wants to merge 26 commits intoPaddlePaddle:developfrom

hushenwei2000:add_moe_ep

Commits on Sep 22, 2025

fix(config): add dsv3 tokenizer file
hushenwei2000
committed
bugfix: ernie dataset tests (#2627)

Jonathans575
authored and
root
committed
remove flashmask checker (#2631)

WYB27
authored and
root
committed
【GPT-OSS】update sliding_attention layer use flashmask (#2606)

xiaoguoguo626807
authored and
root
committed
[Bug] Fix precision of gate and e_score_correction_bias in Glm4Moe (#2637)

DrownFish19
authored and
root
committed
Add Qwen3 download source (#2638)

Ace-To-HYB
authored and
root
committed
[CI] update pytest config (#2620)

Liujie0926
authored and
root
committed
examples update yaml training config (#2644)

llbdyiu66
authored and
root
committed
fix save tensor dtype (#2642)

llbdyiu66
authored and
root
committed
Fix the issue of loading ckpt when retraining (#2645)

Ace-To-HYB
authored and
root
committed

Commits on Sep 23, 2025

feat(MoE Layer): add unified MoE with DeepEP (part 1)
hushenwei2000
committed

Commits on Sep 24, 2025

feat(MoE Layer): add unified MoE with DeepEP (part 1)
hushenwei2000
committed

Commits on Sep 25, 2025

Commits on Sep 26, 2025

feat(MoE Layer): add unified MoE with DeepEP
hushenwei2000
committed

Commits on Sep 29, 2025

Add customized loss system
hushenwei2000
committed

Commits on Sep 30, 2025

Commits on Oct 9, 2025

temporary commit(test): used for test
hushenwei2000
committed