Skip to content

Offload only activated experts to the GPU #698

Merged
ikawrakow merged 5 commits intomainfrom
ik/sched_copy_experts
Sep 4, 2025
Merged

Offload only activated experts to the GPU #698
ikawrakow merged 5 commits intomainfrom
ik/sched_copy_experts

Commits

Commits on Sep 2, 2025