Skip to content

Commit d3ccc50

Browse files
committed
Update ilab
1 parent 5399c25 commit d3ccc50

File tree

2 files changed

+5
-40
lines changed

2 files changed

+5
-40
lines changed
271 KB
Loading

content/modules/ROOT/pages/module-ilab.adoc

Lines changed: 5 additions & 40 deletions
Original file line numberDiff line numberDiff line change
@@ -197,6 +197,7 @@ document:<7>
197197
- Insurance_claims_data.md
198198
- teen_driving_rules.md
199199
- claims_cost_data.md
200+
200201
----
201202

202203
Each `qna.yaml` file requires a minimum of five question-answer pairs. The `qna.yaml` format must include the following fields:
@@ -322,7 +323,6 @@ After running the above command you should be able to see the following output.
322323

323324
[source,bash]
324325
----
325-
└─> ilab diff
326326
knowledge/economy/finance/insurance/parasol/qna.yaml
327327
Taxonomy in /home/instruct/.local/share/instructlab/taxonomy is valid :)
328328
----
@@ -417,10 +417,8 @@ It may take a minute to start, but you should see the following:
417417

418418
[source,bash]
419419
----
420-
(venv) [instruct@bastion instructlab]$ ilab model serve --model-path ~/instructlab/models/parasol-model.gguf
421-
INFO 2024-09-09 16:01:01,652 serve.py:51: serve Using model '/home/instruct/instructlab/models/parasol-model.gguf' with -1 gpu-layers and 4096 max context size.
422-
INFO 2024-09-09 16:02:14,664 server.py:218: server Starting server process, press CTRL+C to shutdown server...
423-
INFO 2024-09-09 16:02:14,664 server.py:219: server After application startup complete see http://127.0.0.1:8000/docs for API.
420+
INFO 2024-11-07 23:03:09,682 instructlab.model.serve:136: Using model '/home/instruct/instructlab/models/parasol-model.gguf' with -1 gpu-layers and 4096 max context size.
421+
INFO 2024-11-07 23:03:09,683 instructlab.model.serve:140: Serving model '/home/instruct/instructlab/models/parasol-model.gguf' with llama-cpp
424422
----
425423

426424
=== Interacting with the Model
@@ -436,7 +434,7 @@ In the new terminal, run the following command to begin a chat session with the
436434
----
437435
cd ~/instructlab
438436
source venv/bin/activate
439-
ilab chat
437+
ilab model chat
440438
----
441439

442440
We can now ask the trained model some parasol specific questions such as:
@@ -496,37 +494,4 @@ This exercise showed how organizations can leverage fine tuning with InstructLab
496494
* You gained hands-on experience in *training and serving* a customized AI model
497495
* You understand the *benefits and limitations* of fine-tuning compared to other AI customization methods
498496

499-
These skills and tools will be invaluable as you continue to develop AI-enabled applications at Parasol Insurance, allowing you to quickly iterate on ideas and integrate powerful AI capabilities into your workflow.
500-
501-
[#appendix]
502-
== Appendix
503-
504-
These commands install VSCode and a few other needed tools. You should not have to run these, it's only here for reference.
505-
506-
[.console-input]
507-
[source,bash]
508-
----
509-
cd ~
510-
curl -L -o files/vscode.rpm 'https://code.visualstudio.com/sha/download?build=stable&os=linux-rpm-x64'
511-
sudo dnf install -y xdg-utils
512-
sudo rpm -ivh files/vscode.rpm
513-
sudo dnf -y install zip gcc glibc-devel zlib-devel firefox
514-
curl -s "https://get.sdkman.io" | bash
515-
source "/home/instruct/.sdkman/bin/sdkman-init.sh"
516-
sdk install java 21.0.3-tem
517-
518-
curl -Lo ~/instructlab/models/parasol-model.gguf https://huggingface.co/rh-rad-ai-roadshow/parasol-merlanite-trained-GGUF/resolve/main/parasol-model-0715-sdg400.gguf?download=true
519-
520-
521-
curl -Lo ~/Documents/marty-mcfly-auto.pdf https://raw.githubusercontent.com/rh-rad-ai-roadshow/parasol-insurance/main/app/src/main/resources/claims/marty-mcfly-auto.pdf
522-
523-
cd ~/instructlab
524-
rm -rf taxonomy
525-
source venv/bin/activate
526-
ilab config init --non-interactive
527-
528-
git clone https://github.com/rh-rad-ai-roadshow/parasol-insurance.git
529-
cd parasol-insurance/app
530-
./mvnw clean package -DskipTests
531-
nohup java -jar -Dquarkus.langchain4j.openai.parasol-chat.base-url=http://localhost:8000/v1 target/quarkus-app/quarkus-run.jar > ~/quarkus.out 2>&1 &
532-
----
497+
These skills and tools will be invaluable as you continue to develop AI-enabled applications at Parasol Insurance, allowing you to quickly iterate on ideas and integrate powerful AI capabilities into your workflow.

0 commit comments

Comments
 (0)