Skip to content

Commit f5f3dcf

Browse files
committed
Make sampling parameter handling more explicit
1 parent 1a82890 commit f5f3dcf

File tree

1 file changed

+5
-3
lines changed

1 file changed

+5
-3
lines changed

docs/specification/draft/client/sampling.mdx

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -246,9 +246,11 @@ LLM sampling can be fine-tuned with the following parameters:
246246
- `stopSequences`: Array of sequences that stop generation.
247247
- `metadata`: Additional provider-specific parameters.
248248

249-
The client **MAY** modify or ignore these fields (except for `maxTokens`) without
250-
communicating this to the server. For example, a client could use a model that does not
251-
support one or more of these parameters, and would therefore be unable to leverage them.
249+
The client **MUST** respect the `maxTokens` parameter.
250+
251+
The client **MAY** modify or ignore `temperature`, `stopSequences` and `metadata`. For
252+
example, a client could use a model that does not support one or more of these parameters,
253+
and would therefore be unable to leverage them.
252254

253255
### Result Fields
254256

0 commit comments

Comments
 (0)