Skip to content

Commit ed82223

Browse files
author
Olivier Chafik
committed
readme: function calling *is* supported now
1 parent fa20249 commit ed82223

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

examples/server/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -126,7 +126,7 @@ The project is under active development, and we are [looking for feedback and co
126126
| `--grammar GRAMMAR` | BNF-like grammar to constrain generations (see samples in grammars/ dir) (default: '') |
127127
| `--grammar-file FNAME` | file to read grammar from |
128128
| `-j, --json-schema SCHEMA` | JSON schema to constrain generations (https://json-schema.org/), e.g. `{}` for any JSON object<br/>For schemas w/ external $refs, use --grammar + example/json_schema_to_grammar.py instead |
129-
| `--jinja` | Enable experimental Jinja templating engine (needed for tool use) |
129+
| `--jinja` | Enable experimental Jinja templating engine (required for tool use) |
130130

131131
**Example-specific params**
132132

@@ -1069,7 +1069,7 @@ Given a ChatML-formatted json description in `messages`, it returns the predicte
10691069

10701070
*Options:*
10711071

1072-
See [OpenAI Chat Completions API documentation](https://platform.openai.com/docs/api-reference/chat). While some OpenAI-specific features such as function calling aren't supported, llama.cpp `/completion`-specific features such as `mirostat` are supported.
1072+
See [OpenAI Chat Completions API documentation](https://platform.openai.com/docs/api-reference/chat). llama.cpp `/completion`-specific features such as `mirostat` are also supported.
10731073

10741074
The `response_format` parameter supports both plain JSON output (e.g. `{"type": "json_object"}`) and schema-constrained JSON (e.g. `{"type": "json_object", "schema": {"type": "string", "minLength": 10, "maxLength": 100}}` or `{"type": "json_schema", "schema": {"properties": { "name": { "title": "Name", "type": "string" }, "date": { "title": "Date", "type": "string" }, "participants": { "items": {"type: "string" }, "title": "Participants", "type": "string" } } } }`), similar to other OpenAI-inspired API providers.
10751075

@@ -1121,7 +1121,7 @@ curl http://localhost:8080/v1/chat/completions \
11211121

11221122
[Function calling](https://platform.openai.com/docs/guides/function-calling) is supported for all models (see https://github.com/ggerganov/llama.cpp/pull/9639):
11231123

1124-
- Needs `--jinja` flag
1124+
- Requires `--jinja` flag
11251125
- Native tool call formats supported:
11261126
- Llama 3.1 / 3.3 (including builtin tools support - tool names for `wolfram_alpha`, `web_search` / `brave_search`, `code_interpreter`), Llama 3.2
11271127
- Functionary v3.1 / v3.2

0 commit comments

Comments
 (0)