We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent de30cb6 commit d512b8bCopy full SHA for d512b8b
examples/eval-callback/README.md
@@ -6,13 +6,16 @@ It simply prints to the console all operations and tensor data.
6
Usage:
7
8
```shell
9
-llama-eval-callback \
10
- --hf-repo ggml-org/models \
11
- --hf-file phi-2/ggml-model-q4_0.gguf \
12
- --model phi-2-q4_0.gguf \
13
- --prompt hello \
14
- --seed 42 \
15
- -ngl 33
+llama-eval-callback \
+--model path/to/model.gguf \
+--parse-layer l_out-31 \
+--n-predict 200 \
+--prompt "What is the capital of France?" \
+--prompt "Explain black holes" \
+--prompt "Give me a joke" > output.txt
16
+--seed 42 \
17
+-ngl 33
18
+
19
```
20
21
Will print:
0 commit comments