# Add Megrez-MoE Architecture Support ggml-org#16724#17052

Closed

tamarPal wants to merge 11 commits intoggml-org:masterfrom

tamarPal:feature/megrez-moe

Commits on Nov 6, 2025

feat: Add Megrez-MoE architecture support

tamarPal
authored and
tamarPal
committed
fix: increase graph nodes for Megrez-MoE warmup

tamarPal
authored and
tamarPal
committed
feat: adapt Megrez-MoE to new models/*.cpp architecture

tamarPal
authored and
tamarPal
committed
refactor: use standard build_moe_ffn instead of custom build_mergez_moe_ffn

tamarPal
authored and
tamarPal
committed
fix: remove trailing whitespace

tamarPal
authored and
tamarPal
committed

Commits on Nov 9, 2025

fix: resolve additional merge issues from rebase

tamarPal
authored and
tamarPal
committed
Add Megrez-MoE GGUF conversion and inference support

tamarPal
authored and
tamarPal
committed
Fix type errors in MegrezMoEModel only (Pyright compliance)

tamarPal
authored and
tamarPal
committed
Fix NoneType division bug in MegrezMoEModel (Pyright)

tamarPal
authored and
tamarPal
committed
Fix None handling in HunYuanMoEModel token list (Pyright)

tamarPal
authored and
tamarPal
committed
Fix None handling (Pyright)

tamarPal
authored and
tamarPal
committed