Skip to content

Commit 2f37014

Browse files
authored
lookahead : add sample command to readme (ggml-org#15447)
* lookahead : add sample command to readme * cont : build-agnostic command
1 parent a094f38 commit 2f37014

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

examples/lookahead/README.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,3 +5,9 @@ Demonstration of lookahead decoding technique:
55
https://lmsys.org/blog/2023-11-21-lookahead-decoding/
66

77
More info: https://github.com/ggml-org/llama.cpp/pull/4207
8+
9+
Sample command:
10+
11+
```bash
12+
llama-lookahead -hf ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF -p "// network server implemented in C\n// author: Peter Hacker\n\n#include" -e -ngl 99 -t 4 -n 512 -c 4096 -kvu
13+
```

0 commit comments

Comments
 (0)