You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Taxonomy in /home/instruct/.local/share/instructlab/taxonomy is valid :)
328
328
----
@@ -417,10 +417,8 @@ It may take a minute to start, but you should see the following:
417
417
418
418
[source,bash]
419
419
----
420
-
(venv) [instruct@bastion instructlab]$ ilab model serve --model-path ~/instructlab/models/parasol-model.gguf
421
-
INFO 2024-09-09 16:01:01,652 serve.py:51: serve Using model '/home/instruct/instructlab/models/parasol-model.gguf' with -1 gpu-layers and 4096 max context size.
422
-
INFO 2024-09-09 16:02:14,664 server.py:218: server Starting server process, press CTRL+C to shutdown server...
423
-
INFO 2024-09-09 16:02:14,664 server.py:219: server After application startup complete see http://127.0.0.1:8000/docs for API.
420
+
INFO 2024-11-07 23:03:09,682 instructlab.model.serve:136: Using model '/home/instruct/instructlab/models/parasol-model.gguf' with -1 gpu-layers and 4096 max context size.
421
+
INFO 2024-11-07 23:03:09,683 instructlab.model.serve:140: Serving model '/home/instruct/instructlab/models/parasol-model.gguf' with llama-cpp
424
422
----
425
423
426
424
=== Interacting with the Model
@@ -436,7 +434,7 @@ In the new terminal, run the following command to begin a chat session with the
436
434
----
437
435
cd ~/instructlab
438
436
source venv/bin/activate
439
-
ilab chat
437
+
ilab model chat
440
438
----
441
439
442
440
We can now ask the trained model some parasol specific questions such as:
@@ -496,37 +494,4 @@ This exercise showed how organizations can leverage fine tuning with InstructLab
496
494
* You gained hands-on experience in *training and serving* a customized AI model
497
495
* You understand the *benefits and limitations* of fine-tuning compared to other AI customization methods
498
496
499
-
These skills and tools will be invaluable as you continue to develop AI-enabled applications at Parasol Insurance, allowing you to quickly iterate on ideas and integrate powerful AI capabilities into your workflow.
500
-
501
-
[#appendix]
502
-
== Appendix
503
-
504
-
These commands install VSCode and a few other needed tools. You should not have to run these, it's only here for reference.
These skills and tools will be invaluable as you continue to develop AI-enabled applications at Parasol Insurance, allowing you to quickly iterate on ideas and integrate powerful AI capabilities into your workflow.
0 commit comments