Offload only activated experts to the GPU #698

Merged

ikawrakow merged 5 commits intomainfrom

ik/sched_copy_experts

Sep 4, 2025

Commits on Sep 2, 2025

Offload only activated experts
Iwan Kawrakow
committed
This seems to do the trick for -fmoe
Iwan Kawrakow
committed
Do not recalculate activated expers for fused up/gate
Iwan Kawrakow
committed
Log out of bounds access details
Iwan Kawrakow
committed
Add a command line argument
Iwan Kawrakow
committed