Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode#15007
Open
matteoserva wants to merge 1 commit intoggml-org:masterfrom
Open
Fix: flush partial stop string when <EOG> is reached in /completion endpoint in streaming mode#15007matteoserva wants to merge 1 commit intoggml-org:masterfrom
matteoserva wants to merge 1 commit intoggml-org:masterfrom