Skip to content

Commit f3f6509

Browse files
committed
improve /v1/completions api with stop: "\nHuman" so that it works better with selfhostedAI like [RWKV-Runner](https://github.com/josStorer/RWKV-Runner)
1 parent 88522ac commit f3f6509

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/services/apis/openai-api.mjs

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,7 @@ export async function generateAnswersWithGptCompletionApi(
5151
stream: true,
5252
max_tokens: config.maxResponseTokenLength,
5353
temperature: config.temperature,
54+
stop: '\nHuman',
5455
}),
5556
onMessage(message) {
5657
console.debug('sse message', message)

0 commit comments

Comments
 (0)