Skip to content

Commit e0986ea

Browse files
authored
Add documentation for granite 4 tool calling (#26175)
Signed-off-by: Max de Bayser <[email protected]>
1 parent a964e5e commit e0986ea

File tree

1 file changed

+5
-1
lines changed

1 file changed

+5
-1
lines changed

docs/features/tool_calling.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -191,10 +191,14 @@ VLLM also provides a pythonic and JSON-based chat template for Llama 4, but pyth
191191

192192
For Llama 4 model, use `--tool-call-parser llama4_pythonic --chat-template examples/tool_chat_template_llama4_pythonic.jinja`.
193193

194-
#### IBM Granite
194+
### IBM Granite
195195

196196
Supported models:
197197

198+
* `ibm-granite/granite-4.0-h-small` and other Granite 4.0 models
199+
200+
Recommended flags: `--tool-call-parser hermes`
201+
198202
* `ibm-granite/granite-3.0-8b-instruct`
199203

200204
Recommended flags: `--tool-call-parser granite --chat-template examples/tool_chat_template_granite.jinja`

0 commit comments

Comments
 (0)