[FEATURE SUPPORT] Optional mask/bias (3D & 4D)#170

Merged

LoserCheems merged 32 commits intomainfrom

make-mask/bias-optional

Sep 19, 2025

Commits on Sep 18, 2025

Commits on Sep 19, 2025

Refactors tensor partitioning for mask and bias in attention computations
algo-home
committed
Adds optional mask and bias support to kernel traits
algo-home
committed
Optimizes block size based on attention parameters
algo-home
committed
Optimizes kernel dispatch based on mask and bias flags
algo-home
committed
Adds conditional compilation for mask and bias support
algo-home
committed
Optimizes backward kernel with compile-time checks for mask and bias
algo-home
committed
Adds const qualifiers to mask and bias parameters
algo-home
committed
Fixes bias gradient handling for 3D bias tensors
algo-home
committed
Refines documentation for attention_mask and attention_bias parameters in flash_dynamic_mask_attention_forward
algo-home
committed
Removes default initialization of attention_bias in _flash_dynamic_mask_attention_forward
algo-home
committed
Fixes bias tensor initialization in FlashDMAttnFunc to handle None case
algo-home
committed
Refactors CUDA extension sources in setup.py to use glob for dynamic file inclusion
algo-home
committed