Skip to content

common: ensure token addition to batch does not exceed llama_batch size#9668

Merged
ggerganov merged 1 commit intoggml-org:masterfrom
matiaslin:protect_parallel
Sep 29, 2024
Merged

common: ensure token addition to batch does not exceed llama_batch size#9668
ggerganov merged 1 commit intoggml-org:masterfrom
matiaslin:protect_parallel

Commits

Commits on Sep 28, 2024