We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent a094f38 commit 2f37014Copy full SHA for 2f37014
examples/lookahead/README.md
@@ -5,3 +5,9 @@ Demonstration of lookahead decoding technique:
5
https://lmsys.org/blog/2023-11-21-lookahead-decoding/
6
7
More info: https://github.com/ggml-org/llama.cpp/pull/4207
8
+
9
+Sample command:
10
11
+```bash
12
+llama-lookahead -hf ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF -p "// network server implemented in C\n// author: Peter Hacker\n\n#include" -e -ngl 99 -t 4 -n 512 -c 4096 -kvu
13
+```
0 commit comments