Skip to content

Commit b2d1728

Browse files
author
Olivier Chafik
committed
update readme section about common model tool call formats
./build/bin/test-chat ../minja/build/tests/*.jinja 2>/dev/null
1 parent 39c1d81 commit b2d1728

File tree

1 file changed

+63
-50
lines changed

1 file changed

+63
-50
lines changed

‎examples/server/README.md‎

Lines changed: 63 additions & 50 deletions
Original file line numberDiff line numberDiff line change
@@ -1136,61 +1136,74 @@ curl http://localhost:8080/v1/chat/completions \
11361136

11371137
| Template | Format |
11381138
|----------|--------|
1139-
| CohereForAI-c4ai-command-r-plus-default.jinja | generic tool calls |
1140-
| CohereForAI-c4ai-command-r-plus-rag.jinja | generic tool calls |
1141-
| CohereForAI-c4ai-command-r-plus-tool_use.jinja | generic tool calls |
1142-
| MiniMaxAI-MiniMax-Text-01.jinja | generic tool calls |
1143-
| NexaAIDev-Octopus-v2.jinja | generic tool calls |
1144-
| NousResearch-Hermes-2-Pro-Llama-3-8B-default.jinja | generic tool calls |
1145-
| NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja | hermes 2 pro tool calls |
1146-
| NousResearch-Hermes-2-Pro-Mistral-7B-default.jinja | generic tool calls |
1147-
| NousResearch-Hermes-2-Pro-Mistral-7B-tool_use.jinja | hermes 2 pro tool calls |
1148-
| NousResearch-Hermes-3-Llama-3.1-70B-default.jinja | generic tool calls |
1149-
| NousResearch-Hermes-3-Llama-3.1-70B-tool_use.jinja | hermes 2 pro tool calls |
1150-
| OrionStarAI-Orion-14B-Chat.jinja | generic tool calls |
1151-
| Qwen-QwQ-32B-Preview.jinja | hermes 2 pro tool calls |
1152-
| Qwen-Qwen2-7B-Instruct.jinja | generic tool calls |
1153-
| Qwen-Qwen2-VL-7B-Instruct.jinja | generic tool calls |
1154-
| Qwen-Qwen2.5-7B-Instruct.jinja | hermes 2 pro tool calls |
1155-
| Qwen-Qwen2.5-Math-7B-Instruct.jinja | hermes 2 pro tool calls |
1156-
| TheBloke-FusionNet_34Bx2_MoE-AWQ.jinja | generic tool calls |
1157-
| abacusai-Fewshot-Metamath-OrcaVicuna-Mistral.jinja | generic tool calls |
1158-
| bofenghuang-vigogne-2-70b-chat.jinja | generic tool calls |
1159-
| databricks-dbrx-instruct.jinja | generic tool calls |
1160-
| deepseek-ai-DeepSeek-Coder-V2-Instruct.jinja | generic tool calls |
1161-
| deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja | deepseek r1 tool calls |
1162-
| deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja | deepseek r1 tool calls |
1163-
| deepseek-ai-DeepSeek-R1-Distill-Qwen-7B.jinja | deepseek r1 tool calls |
1164-
| deepseek-ai-DeepSeek-V2.5.jinja | deepseek r1 tool calls |
1165-
| deepseek-ai-deepseek-coder-33b-instruct.jinja | generic tool calls |
1166-
| google-gemma-2-2b-it.jinja | generic tool calls |
1167-
| google-gemma-7b-it.jinja | generic tool calls |
1168-
| indischepartij-MiniCPM-3B-OpenHermes-2.5-v2.jinja | generic tool calls |
1169-
| mattshumer-Reflection-Llama-3.1-70B.jinja | generic tool calls |
1170-
| meetkai-functionary-medium-v3.2.jinja | functionary v3.2 tool calls |
1171-
| meta-llama-Llama-3.1-8B-Instruct.jinja | llama 3.x tool calls (w/ builtin tools) |
1172-
| meta-llama-Llama-3.2-3B-Instruct.jinja | llama 3.x tool calls |
1173-
| meta-llama-Llama-3.3-70B-Instruct.jinja | llama 3.x tool calls (w/ builtin tools) |
1174-
| meta-llama-Meta-Llama-3.1-8B-Instruct.jinja | llama 3.x tool calls (w/ builtin tools) |
1175-
| microsoft-Phi-3-medium-4k-instruct.jinja | generic tool calls |
1176-
| microsoft-Phi-3-mini-4k-instruct.jinja | generic tool calls |
1177-
| microsoft-Phi-3-small-8k-instruct.jinja | generic tool calls |
1178-
| microsoft-Phi-3.5-mini-instruct.jinja | generic tool calls |
1179-
| microsoft-Phi-3.5-vision-instruct.jinja | generic tool calls |
1180-
| mistralai-Mistral-7B-Instruct-v0.2.jinja | generic tool calls |
1181-
| mistralai-Mistral-Large-Instruct-2407.jinja | mistral nemo tool calls |
1182-
| mistralai-Mistral-Large-Instruct-2411.jinja | generic tool calls |
1183-
| mistralai-Mistral-Nemo-Instruct-2407.jinja | mistral nemo tool calls |
1184-
| mistralai-Mixtral-8x7B-Instruct-v0.1.jinja | generic tool calls |
1185-
| mlabonne-AlphaMonarch-7B.jinja | generic tool calls |
1186-
| nvidia-Llama-3.1-Nemotron-70B-Instruct-HF.jinja | llama 3.x tool calls (w/ builtin tools) |
1187-
| openchat-openchat-3.5-0106.jinja | generic tool calls |
1188-
| teknium-OpenHermes-2.5-Mistral-7B.jinja | generic tool calls |
1139+
| CohereForAI-c4ai-command-r-plus-default.jinja | Generic |
1140+
| CohereForAI-c4ai-command-r-plus-rag.jinja | Generic |
1141+
| CohereForAI-c4ai-command-r-plus-tool_use.jinja | Generic |
1142+
| CohereForAI-c4ai-command-r7b-12-2024-default.jinja | Command R7B |
1143+
| CohereForAI-c4ai-command-r7b-12-2024-rag.jinja | Command R7B |
1144+
| CohereForAI-c4ai-command-r7b-12-2024-tool_use.jinja | Command R7B |
1145+
| Infinigence-Megrez-3B-Instruct.jinja | Generic |
1146+
| LGAI-EXAONE-EXAONE-3.5-7.8B-Instruct.jinja | Generic |
1147+
| MiniMaxAI-MiniMax-Text-01.jinja | Generic |
1148+
| NexaAIDev-Octopus-v2.jinja | Generic |
1149+
| NousResearch-Hermes-2-Pro-Llama-3-8B-default.jinja | Generic |
1150+
| NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja | Hermes 2 Pro |
1151+
| NousResearch-Hermes-2-Pro-Mistral-7B-default.jinja | Generic |
1152+
| NousResearch-Hermes-2-Pro-Mistral-7B-tool_use.jinja | Hermes 2 Pro |
1153+
| NousResearch-Hermes-3-Llama-3.1-70B-default.jinja | Generic |
1154+
| NousResearch-Hermes-3-Llama-3.1-70B-tool_use.jinja | Hermes 2 Pro |
1155+
| OrionStarAI-Orion-14B-Chat.jinja | Generic |
1156+
| Qwen-QwQ-32B-Preview.jinja | Hermes 2 Pro |
1157+
| Qwen-Qwen2-7B-Instruct.jinja | Generic |
1158+
| Qwen-Qwen2-VL-7B-Instruct.jinja | Generic |
1159+
| Qwen-Qwen2.5-7B-Instruct.jinja | Hermes 2 Pro |
1160+
| Qwen-Qwen2.5-Math-7B-Instruct.jinja | Hermes 2 Pro |
1161+
| THUDM-glm-4-9b-chat.jinja | Generic |
1162+
| THUDM-glm-edge-1.5b-chat.jinja | Generic |
1163+
| TheBloke-FusionNet_34Bx2_MoE-AWQ.jinja | Generic |
1164+
| abacusai-Fewshot-Metamath-OrcaVicuna-Mistral.jinja | Generic |
1165+
| ai21labs-AI21-Jamba-1.5-Large.jinja | Generic |
1166+
| bofenghuang-vigogne-2-70b-chat.jinja | Generic |
1167+
| databricks-dbrx-instruct.jinja | Generic |
1168+
| deepseek-ai-DeepSeek-Coder-V2-Instruct.jinja | Generic |
1169+
| deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja | DeepSeek R1 |
1170+
| deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja | DeepSeek R1 |
1171+
| deepseek-ai-DeepSeek-R1-Distill-Qwen-7B.jinja | DeepSeek R1 |
1172+
| deepseek-ai-DeepSeek-V2.5.jinja | DeepSeek R1 |
1173+
| deepseek-ai-deepseek-coder-33b-instruct.jinja | Generic |
1174+
| fireworks-ai-llama-3-firefunction-v2.jinja | FireFunction v2 |
1175+
| google-gemma-2-2b-it.jinja | Generic |
1176+
| google-gemma-7b-it.jinja | Generic |
1177+
| ibm-granite-granite-3.1-8b-instruct.jinja | Generic |
1178+
| indischepartij-MiniCPM-3B-OpenHermes-2.5-v2.jinja | Generic |
1179+
| mattshumer-Reflection-Llama-3.1-70B.jinja | Generic |
1180+
| meetkai-functionary-medium-v3.1.jinja | Functionary v3.1 Llama 3.1 |
1181+
| meetkai-functionary-medium-v3.2.jinja | Functionary v3.2 |
1182+
| meta-llama-Llama-2-7b-chat-hf.jinja | Generic |
1183+
| meta-llama-Llama-3.1-8B-Instruct.jinja | Llama 3.x |
1184+
| meta-llama-Llama-3.2-3B-Instruct.jinja | Llama 3.x |
1185+
| meta-llama-Llama-3.3-70B-Instruct.jinja | Llama 3.x |
1186+
| meta-llama-Meta-Llama-3.1-8B-Instruct.jinja | Llama 3.x |
1187+
| microsoft-Phi-3-medium-4k-instruct.jinja | Generic |
1188+
| microsoft-Phi-3-mini-4k-instruct.jinja | Generic |
1189+
| microsoft-Phi-3-small-8k-instruct.jinja | Generic |
1190+
| microsoft-Phi-3.5-mini-instruct.jinja | Generic |
1191+
| microsoft-Phi-3.5-vision-instruct.jinja | Generic |
1192+
| mistralai-Mistral-7B-Instruct-v0.2.jinja | Generic |
1193+
| mistralai-Mistral-Large-Instruct-2407.jinja | Mistral Nemo |
1194+
| mistralai-Mistral-Large-Instruct-2411.jinja | Generic |
1195+
| mistralai-Mistral-Nemo-Instruct-2407.jinja | Mistral Nemo |
1196+
| mistralai-Mixtral-8x7B-Instruct-v0.1.jinja | Generic |
1197+
| mlabonne-AlphaMonarch-7B.jinja | Generic |
1198+
| nvidia-Llama-3.1-Nemotron-70B-Instruct-HF.jinja | Llama 3.x |
1199+
| openchat-openchat-3.5-0106.jinja | Generic |
1200+
| teknium-OpenHermes-2.5-Mistral-7B.jinja | Generic |
11891201

11901202
This table can be generated with:
11911203

11921204
```bash
11931205
./build/bin/test-chat ../minja/build/tests/*.jinja 2>/dev/null
1206+
```
11941207

11951208
</details>
11961209

0 commit comments

Comments
 (0)