Skip to content

Commit 8be726c

Browse files
authored
Merge branch 'rh-rad-ai-roadshow:main' into main
2 parents a19fd7d + 5e96f7e commit 8be726c

File tree

6 files changed

+26
-30
lines changed

6 files changed

+26
-30
lines changed

content/modules/ROOT/pages/index.adoc

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -12,11 +12,11 @@ Although we use the insurance industry in this workshop the principles are widel
1212

1313
Throughout this workshop, you as a developer will be interfacing with a variety of LLMs deployed on *Red Hat OpenShift AI* and designed for different use cases. Some of these have been fine-tuned with Parasol's private corporate data to demonstrate how organizations like Parasol can achieve business value with AI without giving away their secrets. The models you will use:
1414

15-
* https://huggingface.co/instructlab/merlinite-7b-lab[Merlinite 7B^] - This model is derived from a https://huggingface.co/mistralai[Mistral model^], and trained with the https://arxiv.org/abs/2403.01081[LAB methodology^] and a https://github.com/instructlab/taxonomy[community taxonomy] of data. It has not been tuned with Parasol-specific data.
15+
* https://huggingface.co/ibm-granite/granite-3.0-8b-instruct[IBM Granite-3.0-8B-Instruct^] - This model is developed using a diverse set of techniques with a structured chat format, including supervised finetuning, model alignment using reinforcement learning, and model merging. It has not been tuned with Parasol-specific data.
1616

17-
* **parasol-chat** - This model is derived from the https://huggingface.co/instructlab/granite-7b-lab[InstructLab's Granite model^] and has been fine-tuned using the https://github.com/instructlab/community[InstructLAB project] with a https://github.com/rh-rad-ai-roadshow/parasol-taxonomy[Parasol-specific dataset^]. The name _chat_ implies that this is primarily useful for conversations, and can respond with knowledge of Parasol's private data.
17+
* **parasol-chat** - This model is derived from the https://huggingface.co/ibm-granite/granite-3.0-8b-instruct[IBM Granite-3.0-8B-Instruct^] and has been fine-tuned using the https://github.com/instructlab/community[InstructLAB project] with a https://github.com/rh-rad-ai-roadshow/parasol-taxonomy[Parasol-specific dataset^]. The name _chat_ implies that this is primarily useful for conversations, and can respond with knowledge of Parasol's private data.
1818

19-
* **parasol-instruct** - This model is derived from https://huggingface.co/ibm-granite/granite-7b-instruct[IBM Granite Instruct], and also fine-tuned as above with Parasol-specific data. The name _instruct_ implies that this is primarily good at following instructions to complete a task. This is useful when you want the model to follow explicit instructions, such as "Respond only with JSON with the following schema: {...}".
19+
* **parasol-instruct** - This model is derived from https://huggingface.co/ibm-granite/granite-3.0-8b-instruct[IBM Granite-3.0-8B-Instruct^], and also fine-tuned as above with Parasol-specific data. The name _instruct_ implies that this is primarily good at following instructions to complete a task. This is useful when you want the model to follow explicit instructions, such as "Respond only with JSON with the following schema: {...}".
2020

2121
* **parasol-tools** - This model is based on the https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct[Meta Llama Instruct^] model(s) and has specifically been trained to use agents (also called tools) to complete tasks that you as a developer instruct give it. This is used for "Agentic" applications that provide agents that can do specific tasks like send an email, calculate math problems, and more.
2222

content/modules/ROOT/pages/module-discovery.adoc

Lines changed: 17 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -274,31 +274,31 @@ Select the file `marty-mcfly-auto.pdf`, and click `Open`.
274274

275275
image::discovery/text-summarization-open-claim.png[Podman AI Lab Text Summarization Open Claim]
276276

277-
[NOTE]
278-
====
279-
If you see the following error message, the latest receipe has not been pulled to the RHEL virtual machine yet.
277+
// [NOTE]
278+
// ====
279+
// If you see the following error message, the latest receipe has not been pulled to the RHEL virtual machine yet.
280280

281-
image::discovery/summerizer-error.png[Summerizer Error]
281+
// image::discovery/summerizer-error.png[Summerizer Error]
282282

283-
You can fix this by pulling the lastest recipe from GitHub.
283+
// You can fix this by pulling the lastest recipe from GitHub.
284284

285-
Open a new terminal (_Activities > Show Applications > Terminal_) and run the following command:
285+
// Open a new terminal (_Activities > Show Applications > Terminal_) and run the following command:
286286

287-
[.console-input]
288-
[source,shell,subs="+attributes,macros+"]
289-
----
290-
cd /home/instruct/.local/share/containers/podman-desktop/extensions-storage/redhat.ai-lab/summarizer/recipes/natural_language_processing/summarizer
291-
git pull origin main
292-
----
287+
// [.console-input]
288+
// [source,shell,subs="+attributes,macros+"]
289+
// ----
290+
// cd /home/instruct/.local/share/containers/podman-desktop/extensions-storage/redhat.ai-lab/summarizer/recipes/natural_language_processing/summarizer
291+
// git pull origin main
292+
// ----
293293

294-
Restart the recipe to re-build the container with the updated code.
294+
// Restart the recipe to re-build the container with the updated code.
295295

296-
image::discovery/text-summarization-restart.png[Podman AI Lab Text Summarization Application Restart]
296+
// image::discovery/text-summarization-restart.png[Podman AI Lab Text Summarization Application Restart]
297297

298-
Since the source code has changed, you may be notified from Podman AI Lab that the hash has changed. This is expected behavior, and you can select *Continue* to proceed building the application container image with the updated code.
298+
// Since the source code has changed, you may be notified from Podman AI Lab that the hash has changed. This is expected behavior, and you can select *Continue* to proceed building the application container image with the updated code.
299299

300-
image::discovery/text-summarization-hash-change.png[Podman AI Lab Text Summarization Hash Change]
301-
====
300+
// image::discovery/text-summarization-hash-change.png[Podman AI Lab Text Summarization Hash Change]
301+
// ====
302302

303303
==== Review the summarization that is generated from the claim
304304

@@ -380,8 +380,6 @@ image::discovery/text-summarization-app-refine.png[Podman AI Lab Text Summarizat
380380

381381
By updating the template with these specific requirements, you can tailor the summarization output to provide more detailed and relevant information for insurance claims processing at Parasol Insurance.
382382

383-
==== Save your changes
384-
385383
==== Switch back to Podman Desktop and to the running `Summarizer` recipe
386384

387385
==== Restart the recipe to re-build the container with the updated code

content/modules/ROOT/pages/module-ilab.adoc

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -112,7 +112,7 @@ sh parasol-insurance/scripts/run-parasol-app.sh
112112
This script will perform the following actions:
113113

114114
* Build the Quarkus (_parasol-insurnce_) application
115-
* Run the Quarkus application locally in the REHL VM
115+
* Run the Quarkus application locally in the RHEL VM
116116

117117
It will take a few minutes to complete.
118118

@@ -273,7 +273,7 @@ image::ilab/ilab-taxonomy-qna.png[New folder]
273273
Enter the filename `qna.yaml` to create the file. Then, copy in the following content into the file (using the special copy/paste procedure as before):
274274

275275
[.console-input]
276-
[source,yaml,subs="+attributes,macros+"]
276+
[source,yaml]
277277
----
278278
include::https://raw.githubusercontent.com/rh-rad-ai-roadshow/parasol-taxonomy/refs/heads/main/knowledge/economy/finance/insurance/parasol/qna.yaml[]
279279
@@ -517,4 +517,4 @@ This exercise showed how organizations can leverage fine tuning with InstructLab
517517
* You gained hands-on experience in *training and serving* a customized AI model
518518
* You understand the *benefits and limitations* of fine-tuning compared to other AI customization methods
519519

520-
These skills and tools will be invaluable as you continue to develop AI-enabled applications at Parasol Insurance, allowing you to quickly iterate on ideas and integrate powerful AI capabilities into your workflow.
520+
These skills and tools will be invaluable as you continue to develop AI-enabled applications at Parasol Insurance, allowing you to quickly iterate on ideas and integrate powerful AI capabilities into your workflow.

content/modules/ROOT/pages/module-model-testing.adoc

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -160,9 +160,9 @@ Let's change the model our tests are performed against to an untrained model (*m
160160
{
161161
"jest": {
162162
"nodeEnv": {
163-
"PARASOL_MODEL_URL": "http://merlinite-7b-lab-predictor.aiworkshop.svc.cluster.local:8080/v1/chat/completions",
163+
"PARASOL_MODEL_URL": "http://granite-30-8b-instruct-predictor.aiworkshop.svc.cluster.local:8080/v1/chat/completions",
164164
"EMBEDDING_MODEL_URL": "http://parasol-embedding-predictor.aiworkshop.svc.cluster.local:8080/v1",
165-
"PARASOL_MODEL_NAME": "merlinite-7b-lab"
165+
"PARASOL_MODEL_NAME": "granite-30-8b-instruct"
166166
},
167167
"rootPath": "prompt-testing"
168168
}

content/modules/ROOT/pages/module-private-docs.adoc

Lines changed: 0 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -365,7 +365,6 @@ Open `src/main/resources/application.properties` and overwrite these lines:
365365

366366
[source,properties]
367367
----
368-
quarkus.langchain4j.openai.parasol-chat.chat-model.stop=DONE,done,stop,STOP
369368
quarkus.langchain4j.openai.parasol-chat.chat-model.model-name=parasol-chat
370369
quarkus.langchain4j.openai.parasol-chat.base-url=http://parasol-chat-predictor.aiworkshop.svc.cluster.local:8080/v1
371370
----
@@ -375,7 +374,6 @@ with:
375374
[.console-input]
376375
[source,properties,subs="+attributes,macros+"]
377376
----
378-
# quarkus.langchain4j.openai.parasol-chat.chat-model.stop=DONE,done,stop,STOP
379377
quarkus.langchain4j.openai.parasol-chat.chat-model.model-name=llama3.1
380378
quarkus.langchain4j.openai.parasol-chat.base-url=http://parasol-tools.aiworkshop.svc.cluster.local/v1
381379
----

content/modules/ROOT/pages/module-prompt.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -680,7 +680,7 @@ public record EmailResponse(String subject, String message, String address) { }
680680

681681
image::prompt/new-field-added-to-email-response.png[Add "address" field to EmailResponse Record]
682682

683-
Now let's revisit the https://parasol-app-{user}-dev-parasol-app-{user}-dev.{openshift_cluster_ingress_domain}[web form^] and test out the new AI-generated attribute:
683+
Now let's revisit the https://{user}-parasol-insurance-parasol-webui.{openshift_cluster_ingress_domain}[web form^] and test out the new AI-generated attribute:
684684

685685
- Reload the Email generate page. It take 10 - 20 seconds to recompile and apply the new prompt in the Quarkus dev mode.
686686
- Copy and paste the new claim #1 example from the prior section into the form.

0 commit comments

Comments
 (0)