You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+19-17Lines changed: 19 additions & 17 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -263,21 +263,12 @@ To learn more about model quantization, [read this documentation](examples/quant
263
263
#### A CLI tool for accessing and experimenting with most of `llama.cpp`'s functionality.
264
264
265
265
- <detailsopen>
266
-
<summary>Run simple text completion</summary>
267
-
268
-
```bash
269
-
llama-cli -m model.gguf -p "I believe the meaning of life is" -n 128
270
-
271
-
# I believe the meaning of life is to find your own truth and to live in accordance with it. For me, this means being true to myself and following my passions, even if they don't align with societal expectations. I think that's what I love about yoga – it's not just a physical practice, but a spiritual one too. It's about connecting with yourself, listening to your inner voice, and honoring your own unique journey.
272
-
```
273
-
274
-
</details>
275
-
276
-
- <details>
277
266
<summary>Run in conversation mode</summary>
278
267
268
+
Models with a built-in chat template will automatically activate conversation mode. If this doesn't occur, you can manually enable it by adding `-cnv` and specifying a suitable chat template with `--chat-template NAME`
269
+
279
270
```bash
280
-
llama-cli -m model.gguf -p "You are a helpful assistant" -cnv
271
+
llama-cli -m model.gguf
281
272
282
273
# > hi, who are you?
283
274
# Hi there! I'm your helpful assistant! I'm an AI-powered chatbot designed to assist and provide information to users like you. I'm here to help answer your questions, provide guidance, and offer support on a wide range of topics. I'm a friendly and knowledgeable AI, and I'm always happy to help with anything you need. What's on your mind, and how can I assist you today?
@@ -289,17 +280,28 @@ To learn more about model quantization, [read this documentation](examples/quant
289
280
</details>
290
281
291
282
- <details>
292
-
<summary>Run with custom chat template</summary>
283
+
<summary>Run in conversation mode with custom chat template</summary>
293
284
294
285
```bash
295
-
# use the "chatml" template
296
-
llama-cli -m model.gguf -p "You are a helpful assistant" -cnv --chat-template chatml
286
+
# use the "chatml" template (use -h to see the list of supported templates)
To disable conversation mode explicitly, use `-no-cnv`
299
+
300
+
```bash
301
+
llama-cli -m model.gguf -p "I believe the meaning of life is" -n 128 -no-cnv
302
+
303
+
# I believe the meaning of life is to find your own truth and to live in accordance with it. For me, this means being true to myself and following my passions, even if they don't align with societal expectations. I think that's what I love about yoga – it's not just a physical practice, but a spiritual one too. It's about connecting with yourself, listening to your inner voice, and honoring your own unique journey.
0 commit comments