Add fusion-for-decoder-only for llama #733

Open

binxuan wants to merge 24 commits intoNVIDIA:mainfrom

Commits on Apr 23, 2023

get llama coded
void-main
committed

Commits on Apr 24, 2023

Commits on Apr 25, 2023

Commits on Apr 28, 2023

Commits on Apr 29, 2023

Commits on Apr 30, 2023

support bf16 conversion with bfloat 16 numpy ext
void-main
committed
Merge branch 'main' of https://github.com/void-main/FasterTransformer into main
void-main
committed

Commits on May 1, 2023

Commits on May 2, 2023

update megatron convert script
void-main
committed

Commits on May 6, 2023

Commits on Jun 11, 2023

fix name
void-main
committed

Commits on Jul 28, 2023

add fusion-for-decoder-only for llama
Binxuan Huang
committed