update llama runner to decode single token#6703

Merged

facebook-github-bot merged 4 commits intogh/helunwencser/73/basefrom

gh/helunwencser/73/head

Nov 11, 2024

Commits on Nov 7, 2024

update llama runner to decode single token
helunwencser
committed

Commits on Nov 8, 2024

Update on "update llama runner to decode single token"
helunwencser
committed

Commits on Nov 11, 2024