Flash Attention 4 #318
Description
Given that torch's FlexAttention just added a FA4 backend, do you expect NATTEN with the FlexAttention backend to become faster than your builtin kernels? :)
{{ message }}
Given that torch's FlexAttention just added a FA4 backend, do you expect NATTEN with the FlexAttention backend to become faster than your builtin kernels? :)