[ROCm] Add Torch SDPA and xFormers optimization for FireRedASR#102

Open

sammysun0711 wants to merge 13 commits intoFireRedTeam:mainfrom

sammysun0711:asr_opt_rocm_upstream

Commits on Oct 29, 2025

Commits on Nov 3, 2025

Add attention mask support in batch size > 1 condition for Torch SDPA and xFormers attention
sammysun0711
committed
Refactor xFormers bias_attn handeling with BlockDiagonalMask for batch size > 1 case
sammysun0711
committed
Fix dtype
sammysun0711
committed

Commits on Nov 4, 2025

Fix attn_bias creation in cross attention mask for audio input with variable length
sammysun0711
committed

Commits on Nov 6, 2025

Commits on Nov 7, 2025

Refactor benchmark run benchmark with audio directory with variable length data
sammysun0711
committed

Commits on Nov 12, 2025

Commits on Nov 17, 2025