Add flash attention#19

Draft

jlamypoirier wants to merge 13 commits intomainfrom

add_flash_attention

Commits on Apr 13, 2023

Commits on Apr 14, 2023

Error message
jlamypoirier
committed

Commits on Apr 20, 2023

Attn implementations
jlamypoirier
committed

Commits on Apr 21, 2023

Commits on Apr 22, 2023

Unpad for flash attn, remove flash/torch for decode, misc improvements
jlamypoirier
committed

Commits on Apr 24, 2023