Alit/moe dev2#508

Draft

JRD971000 wants to merge 4 commits intomainfrom

Commits on Oct 22, 2025

init
JRD971000
committed

Commits on Oct 27, 2025

fix moe issues
JRD971000
committed

Commits on Oct 28, 2025

fixpruning when not using score for experts
JRD971000
committed

Commits on Nov 4, 2025

l2 l2 mean
JRD971000
committed