Skip to content

Commit abfdb64

Browse files
committed
Update ilab
1 parent d3ccc50 commit abfdb64

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

content/modules/ROOT/pages/module-ilab.adoc

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -419,6 +419,24 @@ It may take a minute to start, but you should see the following:
419419
----
420420
INFO 2024-11-07 23:03:09,682 instructlab.model.serve:136: Using model '/home/instruct/instructlab/models/parasol-model.gguf' with -1 gpu-layers and 4096 max context size.
421421
INFO 2024-11-07 23:03:09,683 instructlab.model.serve:140: Serving model '/home/instruct/instructlab/models/parasol-model.gguf' with llama-cpp
422+
INFO 2024-11-07 23:04:57,699 instructlab.model.backends.llama_cpp:232: Replacing chat template:
423+
{% for message in messages %}
424+
{% if message['role'] == 'user' %}
425+
{{ '<|user|>
426+
' + message['content'] }}
427+
{% elif message['role'] == 'system' %}
428+
{{ '<|system|>
429+
' + message['content'] }}
430+
{% elif message['role'] == 'assistant' %}
431+
{{ '<|assistant|>
432+
' + message['content'] + eos_token }}
433+
{% endif %}
434+
{% if loop.last and add_generation_prompt %}
435+
{{ '<|assistant|>' }}
436+
{% endif %}
437+
{% endfor %}
438+
INFO 2024-11-07 23:04:57,702 instructlab.model.backends.llama_cpp:189: Starting server process, press CTRL+C to shutdown server...
439+
INFO 2024-11-07 23:04:57,702 instructlab.model.backends.llama_cpp:190: After application startup complete see http://127.0.0.1:8000/docs for API.
422440
----
423441

424442
=== Interacting with the Model

0 commit comments

Comments
 (0)