Skip to content

Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode#15007

Merged
ggerganov merged 1 commit intoggml-org:masterfrom
matteoserva:fix_stop_bug
Oct 23, 2025
Merged

Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode#15007
ggerganov merged 1 commit intoggml-org:masterfrom
matteoserva:fix_stop_bug

Commits

Commits on Oct 23, 2025