Skip to content

Commit 5e6f2a2

Browse files
author
ochafik
committed
add deepseek models to server tool call section in readme
1 parent 19bea4e commit 5e6f2a2

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

examples/server/README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1206,6 +1206,8 @@ curl http://localhost:8080/v1/chat/completions \
12061206
llama-server --jinja -fa -hf bartowski/Mistral-Nemo-Instruct-2407-GGUF:Q6_K_L
12071207
llama-server --jinja -fa -hf bartowski/functionary-small-v3.2-GGUF:Q4_K_M
12081208
llama-server --jinja -fa -hf bartowski/Llama-3.3-70B-Instruct-GGUF:Q4_K_M
1209+
llama-server --jinja -fa -hf bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF:Q4_K_M
1210+
llama-server --jinja -fa -hf bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF:Q6_K_L
12091211
12101212
# Native support requires the right template for these GGUFs:
12111213

0 commit comments

Comments
 (0)