common: ensure token addition to batch does not exceed llama_batch size#9668
Merged
ggerganov merged 1 commit intoggml-org:masterfrom Sep 29, 2024
Merged
common: ensure token addition to batch does not exceed llama_batch size#9668ggerganov merged 1 commit intoggml-org:masterfrom
ggerganov merged 1 commit intoggml-org:masterfrom