Attention Dispatcher#11368

Closed

a-r-r-o-w wants to merge 14 commits intomainfrom

attention-dispatcher

Commits on Apr 19, 2025

Commits on Apr 20, 2025

context manager for switching provider
a-r-r-o-w
committed

Commits on Apr 21, 2025

fix flash/sage seqlen preparation when kv len does not match q len (cross attention)
a-r-r-o-w
committed
fix flash-attn input shape bug; remove custom block mask code; update flux attention processors
a-r-r-o-w
committed

Commits on Apr 22, 2025

Merge branch 'main' into attention-dispatcher
a-r-r-o-w
authored

Commits on May 14, 2025

Commits on May 15, 2025

refactor; flex attention fixes for compile compatibility
a-r-r-o-w
committed

Commits on May 16, 2025

Commits on May 30, 2025

add support for FA3, NPU, XLA
a-r-r-o-w
committed

Commits on Jun 4, 2025