Skip to content

Commit 3a09ae7

Browse files
author
Olivier Chafik
committed
Update function-calling.md
1 parent b691841 commit 3a09ae7

File tree

1 file changed

+5
-3
lines changed

1 file changed

+5
-3
lines changed

docs/function-calling.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -276,9 +276,11 @@ This table can be generated with:
276276

277277
</details>
278278

279-
# Usage: need a tool-use Jinja template!
279+
# Usage - need tool-aware Jinja template
280280

281-
Start a server with any model (make sure it has a tool call template: can verify this by inspecting the `chat_template` or `chat_template_tool_use` properties in `http://localhost:8080/props`):
281+
First, start a server with any model, but make sure it has a tools-enabled template: you can verify this by inspecting the `chat_template` or `chat_template_tool_use` properties in `http://localhost:8080/props`).
282+
283+
Here are some models known to work (w/ chat template override when needed):
282284

283285
```shell
284286
# Native support:
@@ -317,7 +319,7 @@ llama-server --jinja -fa -hf bartowski/c4ai-command-r-v01-GGUF:Q2_K
317319
```
318320

319321
> [!TIP]
320-
> If there is no official `tool_use` Jinja template, you may want to set `--chat-template chatml` to use a default that works with many models (YMMV!)
322+
> If there is no official `tool_use` Jinja template, you may want to set `--chat-template chatml` to use a default that works with many models (YMMV!), or write your own (e.g. we provide a custom [llama-cpp-deepseek-r1.jinja](../models/templates/llama-cpp-deepseek-r1.jinja) for DeepSeek R1 distills)
321323
322324
Test in CLI (or with any library / software that can use OpenAI-compatible API backends):
323325

0 commit comments

Comments
 (0)