Enable Runtime Selection of Attention Functions#9639

Merged

comfyanonymous merged 39 commits intomasterfrom

attention-select

Sep 12, 2025

Commits on Aug 27, 2025

Looking into a @wrap_attn decorator to look for 'optimized_attention_override' entry in transformer_options
Kosinkadink
committed

Commits on Aug 29, 2025

Make sure wrap_attn doesn't make itself recurse infinitely, attempt to load SageAttention and FlashAttention if not enabled so that they can be marked as available or not, create registry for avail…
Kosinkadink
committed
Turn off attention logging for now, make AttentionOverrideTestNode have a dropdown with available attention (this is a test node only)
Kosinkadink
committed
Make flux work with optimized_attention_override
Kosinkadink
committed
Add logs to verify optimized_attention_override is passed all the way into attention function
Kosinkadink
committed
Make Qwen work with optimized_attention_override
Kosinkadink
committed
Made hidream work with optimized_attention_override
Kosinkadink
committed
Made wan patches_replace work with optimized_attention_override
Kosinkadink
committed
Made SD3 work with optimized_attention_override
Kosinkadink
committed
Made HunyuanVideo work with optimized_attention_override
Kosinkadink
committed
Made Mochi work with optimized_attention_override
Kosinkadink
committed
Made LTX work with optimized_attention_override
Kosinkadink
committed
Made StableAudio work with optimized_attention_override
Kosinkadink
committed
Made optimized_attention_override work with ACE Step
Kosinkadink
committed
Made Hunyuan3D work with optimized_attention_override
Kosinkadink
committed
Make CosmosPredict2 work with optimized_attention_override
Kosinkadink
committed
Made CosmosVideo work with optimized_attention_override
Kosinkadink
committed
Made Omnigen 2 work with optimized_attention_override
Kosinkadink
committed
Made StableCascade work with optimized_attention_override
Kosinkadink
committed
Made AuraFlow work with optimized_attention_override
Kosinkadink
committed
Made Lumina work with optimized_attention_override
Kosinkadink
committed
Made Chroma work with optimized_attention_override
Kosinkadink
committed
Made SVD work with optimized_attention_override
Kosinkadink
committed
Fix WanI2VCrossAttention so that it expects to receive transformer_options
Kosinkadink
committed
Fixed Wan2.1 Fun Camera transformer_options passthrough
Kosinkadink
committed
Fixed WAN 2.1 VACE transformer_options passthrough
Kosinkadink
committed

Commits on Sep 12, 2025