Various fused ops around expert selection#840

Merged

ikawrakow merged 9 commits intomainfrom

ik/fused_bailingmoev2

Oct 19, 2025

Commits on Oct 18, 2025

Fuse sigmoid+add+grouped_topk+get_rows (CPU)
Iwan Kawrakow
committed
Fix CPU + CUDA
Iwan Kawrakow
committed

Commits on Oct 19, 2025

Minor
Iwan Kawrakow
committed
Fuse sigmoid+add+topk+get_rows (CUDA)
Iwan Kawrakow
committed
Fuse sigmoid+add+topk+get_rows (CPU)
Iwan Kawrakow
committed
Fuse topk+view+get_rows+reshape+softmax (CPU)
Iwan Kawrakow
committed
Fuse topk+view+get_rows+reshape+softmax (CUDA)
Iwan Kawrakow
committed
cpu: turn off the openai topk fusing for now
Iwan Kawrakow
committed
Also fuse sum_rows and div
Iwan Kawrakow
committed