Skip to content

Commit a34f49d

Browse files
authored
Update documentation for new completion parameter
1 parent f04dea7 commit a34f49d

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

tools/server/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -226,6 +226,7 @@ services:
226226
### Multimodal support
227227
228228
Multimodal support was added in [#12898](https://github.com/ggml-org/llama.cpp/pull/12898) and is currently an experimental feature.
229+
It is currently available in the non-OAI-compatible completion endpoint, and the OAI-compatible chat endpoint.
229230
230231
For more details, please refer to [multimodal documentation](../../docs/multimodal.md)
231232
@@ -407,6 +408,8 @@ Multiple prompts are also supported. In this case, the completion result will be
407408
- Strings and sequences of tokens: `["string1", [12, 34, 56]]`
408409
- Mixed types: `[[12, 34, "string", 56, 78], [12, 34, 56], "string"]`
409410

411+
`multimodal_data`: Optional. Should be an array of strings, containing base64 encoded multimodal data (e.g. images, audio). There must be an identical number of MTMD media markers in the raw prompt which act as placeholders for the data provided to this parameter. The multimodal data files will be substituted in order.
412+
410413
`temperature`: Adjust the randomness of the generated text. Default: `0.8`
411414

412415
`dynatemp_range`: Dynamic temperature range. The final temperature will be in the range of `[temperature - dynatemp_range; temperature + dynatemp_range]` Default: `0.0`, which is disabled.

0 commit comments

Comments
 (0)