Skip to content

Qualcomm AI Engine Direct - Suport batch prefill mode for llama3.2#6983

Merged
cccclai merged 8 commits intopytorch:mainfrom
CodeLinaro:dev1/chunit/bert_mode
Dec 3, 2024
Merged

Qualcomm AI Engine Direct - Suport batch prefill mode for llama3.2#6983
cccclai merged 8 commits intopytorch:mainfrom
CodeLinaro:dev1/chunit/bert_mode

Commits

Commits on Dec 1, 2024