Code change to use flash attn 2#202

Open

yhyu13 wants to merge 2 commits intoOpenBMB:masterfrom

Commits on Nov 22, 2023

Code change to use flash attn 2
yhyu13
committed

Commits on Nov 23, 2023

Use QLoRA along side flash attn2
yhyu13
committed