Added Open-WebUI

jjasghar · jjasghar · commit ecd75a6acf0f · 2025-01-09T15:43:21.000-06:00
Added open-webui and removed old references to tracking.

Signed-off-by: JJ Asghar &lt;awesome@ibm.com&gt;
diff --git a/docs/README.md b/docs/README.md
@@ -47,4 +47,3 @@ This workshop has been tested on the following platforms:
 * [Gabe Goodhart](https://github.com/gabe-l-hart)
 * [Ming Zhao](https://github.com/mingxzhao)
 
-<img src="https://count.asgharlabs.io/count?p=/main_opensource_ai_page">
diff --git a/docs/images/openwebui_main_screen.png b/docs/images/openwebui_main_screen.png
diff --git a/docs/images/openwebui_open_screen.png b/docs/images/openwebui_open_screen.png
diff --git a/docs/images/openwebui_user_setup_screen.png b/docs/images/openwebui_user_setup_screen.png
diff --git a/docs/images/openwebui_who_is_batman.png b/docs/images/openwebui_who_is_batman.png
diff --git a/docs/lab-1/README.md b/docs/lab-1/README.md
@@ -95,5 +95,4 @@ Now let's continue on to Lab 2, where we are going to actually try this process
 
 [paper]: https://arxiv.org/pdf/2405.04324?utm_source=ibm_developer&utm_content=in_content_link&utm_id=tutorials_awb-local-ai-copilot-ibm-granite-code-ollama-continue
 
-<img src="https://count.asgharlabs.io/count?p=/lab1_opensource_ai_page">
 
diff --git a/docs/lab-2/README.md b/docs/lab-2/README.md
@@ -188,4 +188,3 @@ if you want a quick video of other neat <https://continue.dev> functions we didn
 
 On to the next lab!
 
-<img src="https://count.asgharlabs.io/count?p=/lab2_opensource_ai_page>
diff --git a/docs/lab-3.5/README.md b/docs/lab-3.5/README.md
@@ -0,0 +1,74 @@
+---
+title: Configuring Open-WebUI
+description: Steps to configure Open-WebUI for usage
+logo: images/ibm-blue-background.png
+---
+
+# Configuring Open-WebUI
+
+Now that you've gotten [Open-WebUI installed](../pre-work/README.md#open-webui) we need to configure it with `ollama` and Open-WebUI
+to talk to one another. The following screenshots will be from a Mac, but the gist of this should be the same on Windows and Linux.
+
+Open up Open-WebUI (assuming all you have done is `open-webui serve` and
+nothing else), and you should see something like the following:
+![default screen](../images/openwebui_open_screen.png)
+
+If you see this that means Open-WebUI is installed correctly, and we can continue configuration, if not, please find a workshop TA or
+raise your hand we'll be there to help you ASAP.
+
+Before clicking the "Getting Started" button, make sure that `ollama` has
+`granite3.1-dense` pulled down.
+
+Run the following command to confirm you have the [granite3.1-dense](https://ollama.com/library/granite3.1-dense)
+model downloaded in `ollama`. This may take a bit, but we should have a way to copy it directly on your laptop.
+
+If you didn't know, the supported languages with `granite3.1-dense` now include:
+- English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, Chinese (Simplified)
+
+And the Capabilities also include:
+- Summarization
+- Text classification
+- Text extraction
+- Question-answering
+- Retrieval Augmented Generation (RAG)
+- Code related tasks
+- Function-calling tasks
+- Multilingual dialog use cases
+- Long-context tasks including long document/meeting summarization, long document QA, etc.
+
+!!! note
+    We need to figure out a way to copy the models into ollama without downloading.
+
+```bash
+ollama pull granite3.1-dense:8b
+```
+
+Click the "Getting Started" button, and fill out the next screen, and click the
+"Create Admin Account"
+
+![user setup screen](../images/openwebui_user_setup_screen.png)
+
+You should see the main page now, with `granite3.1-dense:latest` right there in
+the center!
+
+![main screen](../images/openwebui_main_screen.png)
+
+Ask it a question, see that it works as you expect...may I suggest:
+
+```
+Who is Batman?
+```
+
+![batman](../images/openwebui_who_is_batman.png)
+
+Now you may notice that the answer is slighty different then the screen shot above. That's expected and nothing to worry about. If
+you have more questions about it raise your hand and one of the helpers would love to talk you about it.
+
+Congratulations! You have Open-WebUI running now, configured to work with `granite3.1-dense` and `Ollama`!
+
+!!! note
+    This was done on your local machine, take a moment and realize if you
+    needed to create a shared AI enviroment, this could be easily leveraged
+    here. This is very out of scope of this workshop, but the TAs can help if
+    you have some general questions around running this in this "space."
+
diff --git a/docs/lab-3/README.md b/docs/lab-3/README.md
@@ -6,7 +6,7 @@ logo: images/ibm-blue-background.png
 
 # Configuring AnythingLLM
 
-Now that you've gotten [AnythingLLM installed](../pre-work/#anythingllm) we need to configure it with `ollama` and AnythingLLM
+Now that you've gotten [AnythingLLM installed](../pre-work/README.md#anythingllm) we need to configure it with `ollama` and AnythingLLM
 to talk to one another. The following screenshots will be from a Mac, but the gist of this should be the same on Windows and Linux.
 
 Open up AnyThingLLM, and you should see something like the following:
diff --git a/docs/lab-4/README.md b/docs/lab-4/README.md
@@ -57,4 +57,3 @@ problem leveraging development processes.
 
 Now that you see this overview, lets actually get into some prompts and helpful prompt templates.
 
-<img src="https://count.asgharlabs.io/count?p=/lab4_opensource_ai_page>
diff --git a/docs/pre-work/README.md b/docs/pre-work/README.md
@@ -9,6 +9,7 @@ You'll need:
 - [One of the Jetbrains IDEs](#jetbrains) - You can choose the one you want, if the wifi is bad, please reach out to a TA to give you a USB stick.
 - [Python](#python) - If you don't already have a proficently in a languge, please follow the `python` steps.
 - [AnythingLLM](#anythingllm) - This will be a GUI interface to your LLM(s).
+- [Open WebUI](#open-webui) - This is a browser based GUI for your LLM(s).
 
 ## Ollama
 
@@ -66,7 +67,7 @@ this workshop will be, you should pick
 Python is a whole programming language. There are multiple ways to install it, and
 [here is the official website](https://www.python.org). Please take a moment and if you can't run
 the following command, reach out to a teaching assistant or instructor to help you
-get resolved.
+ get resolved.
 
 !!! note
     If you have an older version of python, or default "OS" versions of python, you'll need to update.
@@ -94,4 +95,24 @@ With this you should have the applications you need, let's start the workshop!
 Head on over [here](https://anythingllm.com/desktop) choose the correct version
 for your Operating System. We will configure it later in the workshop.
 
-<img src="https://count.asgharlabs.io/count?p=/prework_opensource_ai_page>
+## Open-Webui
+
+If you have decided to run the Web Based/Browser based way to interact with your LLM(s) [open-webui](https://github.com/open-webui/open-webui)
+is a fine if not _the_ defacto choice.
+
+!!! note
+    You only need to pick one of AnythingLLM or Open-WebUI, though you could
+    pick both, it's really up to you!
+
+Assuming you've set up [Python](#python) above, you'll need the following commands
+to get it installed.
+
+```bash
+cd ~
+mkdir openweb-ui
+cd openweb-ui
+python3.11 -m venv --upgrade-deps venv
+source venv/bin/activate
+pip install open-webui
+open-webui serve
+```
diff --git a/mkdocs.yml b/mkdocs.yml
@@ -17,6 +17,7 @@ nav:
     - Lab 1. Building a local AI co-pilot: lab-1/README.md
     - Lab 2. Using the local AI co-pilot: lab-2/README.md
     - Lab 3. Configuring AnythingLLM: lab-3/README.md
+    - Lab 3.5 Configuring Open-WebUI: lab-3.5/README.md
     - Lab 4. Prompt engineering overview: lab-4/README.md
     - Lab 5. Useful prompts and use cases: lab-5/README.md
   - References:

Original file line number	Diff line number	Diff line change
`@@ -47,4 +47,3 @@ This workshop has been tested on the following platforms:`
`47`	`47`	`* [Gabe Goodhart](https://github.com/gabe-l-hart)`
`48`	`48`	`* [Ming Zhao](https://github.com/mingxzhao)`
`49`	`49`
`50`		`-<img src="https://count.asgharlabs.io/count?p=/main_opensource_ai_page">`
Original file line number	Diff line number	Diff line change
`@@ -95,5 +95,4 @@ Now let's continue on to Lab 2, where we are going to actually try this process`
`95`	`95`
`96`	`96`	`[paper]: https://arxiv.org/pdf/2405.04324?utm_source=ibm_developer&utm_content=in_content_link&utm_id=tutorials_awb-local-ai-copilot-ibm-granite-code-ollama-continue`
`97`	`97`
`98`		`-<img src="https://count.asgharlabs.io/count?p=/lab1_opensource_ai_page">`
`99`	`98`
Original file line number	Diff line number	Diff line change
`@@ -188,4 +188,3 @@ if you want a quick video of other neat <https://continue.dev> functions we didn`
`188`	`188`
`189`	`189`	`On to the next lab!`
`190`	`190`
`191`		`-<img src="https://count.asgharlabs.io/count?p=/lab2_opensource_ai_page>`
Original file line number	Diff line number	Diff line change
`@@ -57,4 +57,3 @@ problem leveraging development processes.`
`57`	`57`
`58`	`58`	`Now that you see this overview, lets actually get into some prompts and helpful prompt templates.`
`59`	`59`
`60`		`-<img src="https://count.asgharlabs.io/count?p=/lab4_opensource_ai_page>`