Skip to content

Commit 720fec0

Browse files
committed
cont : add note about base models [no ci]
1 parent f10ebf7 commit 720fec0

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

examples/parallel/README.md

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,3 +9,6 @@ Generate 128 client requests (`-ns 128`), simulating 8 concurrent clients (`-np
99
```bash
1010
llama-parallel -m model.gguf -np 8 -ns 128 --top-k 1 -pps --junk 10 -c 16384
1111
```
12+
13+
> [!NOTE]
14+
> It's recommended to use base models with this example. Instruction tuned models might not be able to properly follow the custom chat template specified here, so the results might not be as expected.

0 commit comments

Comments
 (0)