Merge pull request #28 from jbusche/jim-rag-draft1

First draft at OpenWebUI RAG lab

Author: jjasghar

docs/images/History_of_IBM_summary.png

@@ -0,0 +1,98 @@
+---
+title: Using Open-WebUI for a local RAG
+description: Learn how to build a simple local RAG
+logo: images/ibm-blue-background.png
+---
+
+## Retrieval-Augmented Generation overview
+The LLMs we're using for these labs have been trained on billions of parameters, but they haven't been trained on everything, and the smaller models have less general knowledge to work with.
+For example, even the latest models are trained with aged data, and they couldn't know about current events or the unique data your use-case might need. 
+
+RAG allows the user to supplement the LLM's data with up-to-date information from external sources, like databases and documents. 
+
+In this lab we're going to use one of the smallest IBM Granite models and show that it's answer is not complete. Then we'll add a small RAG document and allow it render a much better answer 
+utilizing both it's internal data combined with the RAG data you give it.
+
+## Configuration and Sanity Check
+
+Open up [Open-WebUI](http://localhost:8080/), and you should see something like the following:
+![default screen](../images/openwebui_open_screen.png)
+
+If you see this that means Open-WebUI is installed correctly, and we can continue configuration, if not, please find a workshop TA or
+raise your hand we'll be there to help you ASAP.
+
+Next as a sanity check, run the following command to confirm you have the [granite3.3:2b](https://ollama.com/library/granite3.3:2b)
+model downloaded in `ollama`. This may take a bit, but we should have a way to copy it directly on your laptop.
+
+```bash
+ollama pull granite3.3:2b
+```
+
+If you didn't know, the supported languages with `granite3.3:2b` now include:
+
+- English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, Chinese (Simplified)
+
+And the Capabilities also include:
+
+- Thinking
+- Summarization
+- Text classification
+- Text extraction
+- Question-answering
+- Retrieval Augmented Generation (RAG)
+- Code related tasks
+- Function-calling tasks
+- Multilingual dialog use cases
+- Fill-in-the-middle
+- Long-context tasks including long document/meeting summarization, long document QA, etc.
+
+
+Next click on the down arrow at the top and select the "granite3.3:2b" if it's not already selected.
+
+![model selection](../images/openwebui_model_selection.png)
+
+Click on the "New Chat" icon to clear the context. Then, ask the model for:
+```bash
+List all the past and current CEOs of the IBM corporation in order of their term as CEO
+```
+For example:
+![Small LLM CEO list](../images/small_llm_ceo_list.png)
+
+At first glance, the list looks pretty good. But if you know your IBM CEOs, you'll notice that it misses a few of them, and sometimes adds new names that weren't ever IBM CEOs!
+(Note: the larger granite3.3:8b does a much better job on the IBM CEOs, you can try it later)
+But we can provide the small LLM with a RAG document that supplements the model's missing informaiton with a correct list, so it will generate a better answer.
+
+Click on the "New Chat" icon to clear the context.  Then download a small text file with the correct list of IBM CEOs to your Downloads folder:
+
+[IBM.txt](../resources/IBM.txt)
+
+Right click on the IBM.txt URL and select "Save Link As" and save it as IBM in your Downloads folder.
+
+In your Open-WebUI browser, click on the "+" under the "send a message" prompt and then select "Upload files"
+
+Select the IBM.txt file that you just downloaded in your Downloads folder and press Open.
+
+![RAG Doc Added](../images/rag_doc_added.png)
+
+Now ask it our question about the CEOs of IBM:
+```bash
+List all the past and current CEOs of the IBM corporation in order of their term as CEO
+```
+The answer should now be correct. (For example, always before it forgets John Akers)
+
+![CEO list with RAG](../images/ceo_list_with_rag.png)
+
+We can also find and download information to pdf from Wikipedia:
+For example: [History of IBM](https://en.wikipedia.org/wiki/History_of_IBM)
+
+On the right of the Wikipedia page, click on "Tools" and click on "Download as PDF"
+
+Then use this History_of_IBM.pdf as a RAG by clicking on the + and select "History_of_IBM.pdf" as a file from your Downloads folder.
+
+Next, use the Open-WebUI to ask more questions about IBM, or have it summarize the document itself.  For example:
+```bash
+Write a short 300 word summary of the History_of_IBM.pdf
+```
+![Summary of IBM History](../images/History_of_IBM_summary.png)
+
+Congratulations, you've completed the Open-WebUI RAG example.

docs/images/ceo_list_with_rag.png

@@ -0,0 +1,31 @@
+List of all the past and current CEOs of the IBM corporation in order of their term as CEO
+
+Arvind Krishna (2021 - present) Male
+years as CEO: CEO 2021 - Present
+
+Virginia M. (Ginni) Rometty (2012 - 2020) Female
+years as CEO: CEO 2012 - 2020
+
+Samuel J. Palmisano (2002 - 2011) Male
+years as CEO: CEO 2002 - 2011
+
+Louis V. Gerstner, Jr. (1993 - 2002) Male
+years as CEO: CEO 1993 - 2002
+
+John F. Akers (1985 - 1993) Male
+years as CEO: CEO 1985 - 1993
+
+John R. Opel (1981 - 1985) Male
+years as CEO: CEO 1981 - 1985
+
+Frank T. Cary (1973 - 1981) Male
+years as CEO: CEO 1973 - 1981
+
+T. Vincent Learson (1971 - 1973) Male
+years as CEO: CEO 1971 - 1973
+
+Thomas J. Watson, Jr. (1956 - 1971) Male
+years as CEO: CEO 1956 - 1971
+
+Thomas J. Watson (1914 - 1956) Male
+years as CEO: CEO 1914 - 1956