You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: content/modules/ROOT/pages/module-ilab.adoc
+18Lines changed: 18 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -419,6 +419,24 @@ It may take a minute to start, but you should see the following:
419
419
----
420
420
INFO 2024-11-07 23:03:09,682 instructlab.model.serve:136: Using model '/home/instruct/instructlab/models/parasol-model.gguf' with -1 gpu-layers and 4096 max context size.
421
421
INFO 2024-11-07 23:03:09,683 instructlab.model.serve:140: Serving model '/home/instruct/instructlab/models/parasol-model.gguf' with llama-cpp
422
+
INFO 2024-11-07 23:04:57,699 instructlab.model.backends.llama_cpp:232: Replacing chat template:
423
+
{% for message in messages %}
424
+
{% if message['role'] == 'user' %}
425
+
{{ '<|user|>
426
+
' + message['content'] }}
427
+
{% elif message['role'] == 'system' %}
428
+
{{ '<|system|>
429
+
' + message['content'] }}
430
+
{% elif message['role'] == 'assistant' %}
431
+
{{ '<|assistant|>
432
+
' + message['content'] + eos_token }}
433
+
{% endif %}
434
+
{% if loop.last and add_generation_prompt %}
435
+
{{ '<|assistant|>' }}
436
+
{% endif %}
437
+
{% endfor %}
438
+
INFO 2024-11-07 23:04:57,702 instructlab.model.backends.llama_cpp:189: Starting server process, press CTRL+C to shutdown server...
439
+
INFO 2024-11-07 23:04:57,702 instructlab.model.backends.llama_cpp:190: After application startup complete see http://127.0.0.1:8000/docs for API.
0 commit comments