Skip to content

Commit 04b0a46

Browse files
committed
added doc for client parameter
1 parent e775ff3 commit 04b0a46

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

examples/server/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -391,6 +391,9 @@ By default, this value is set to `0`, meaning no tokens are kept. Use `-1` to re
391391

392392
`stream`: Allows receiving each predicted token in real-time instead of waiting for the completion to finish (uses a different response format). To enable this, set to `true`.
393393

394+
`start_strings`: Specify a JSON array of starting strings.
395+
The output of the model is discarded until the first start string is reached, the matching string is not included in the completion. Default: `[]`
396+
394397
`stop`: Specify a JSON array of stopping strings.
395398
These words will not be included in the completion, so make sure to add them to the prompt for the next iteration. Default: `[]`
396399

0 commit comments

Comments
 (0)