Skip to content

Commit 4622fad

Browse files
ikawrakowjeffbolznvIwan Kawrakow
authored
Vulkan: flash attention for DeepSeek models (#584)
* vulkan: support mixed/deepseekR1 FA head sizes (#14509) * vulkan: better parameterize FA by head sizes * vulkan: support mixed/deepseekR1 FA head sizes * Fix the FA cherry-pick --------- Co-authored-by: Jeff Bolz <[email protected]> Co-authored-by: Iwan Kawrakow <[email protected]>
1 parent 0678427 commit 4622fad

File tree

5 files changed

+211
-186
lines changed

5 files changed

+211
-186
lines changed

0 commit comments

Comments
 (0)