| 
 | 1 | +# RAG in 5 Minutes  | 
 | 2 | + | 
 | 3 | +This implementation is tied to the [YouTube video on NVIDIA Developer](https://youtu.be/N_OOfkEWcOk).  | 
 | 4 | + | 
 | 5 | +This is a simple standalone implementation showing a minimal RAG pipeline that uses models available from [NVIDIA API Catalog](https://catalog.ngc.nvidia.com/ai-foundation-models).  | 
 | 6 | +The catalog enables you to experience state-of-the-art LLMs accelerated by NVIDIA.  | 
 | 7 | +Developers get free credits for 10K requests to any of the models.  | 
 | 8 | + | 
 | 9 | +The example uses an [integration package to LangChain](https://python.langchain.com/docs/integrations/providers/nvidia) to access the models.  | 
 | 10 | +NVIDIA engineers develop, test, and maintain the open source integration.  | 
 | 11 | +This example uses a simple [Streamlit](https://streamlit.io/) based user interface and has a one-file implementation.  | 
 | 12 | +Because the example uses the models from the NVIDIA API Catalog, you do not need a GPU to run the example.  | 
 | 13 | + | 
 | 14 | +### Steps  | 
 | 15 | + | 
 | 16 | +1. Create a python virtual environment and activate it:  | 
 | 17 | + | 
 | 18 | +   ```comsole  | 
 | 19 | +   python3 -m virtualenv genai  | 
 | 20 | +   source genai/bin/activate  | 
 | 21 | +   ```  | 
 | 22 | + | 
 | 23 | +1. From the root of this repository, `GenerativeAIExamples`, install the requirements:  | 
 | 24 | + | 
 | 25 | +   ```console  | 
 | 26 | +   pip install -r community/5_mins_rag_no_gpu/requirements.txt  | 
 | 27 | +   ```  | 
 | 28 | + | 
 | 29 | +1. Add your NVIDIA API key as an environment variable:  | 
 | 30 | + | 
 | 31 | +   ```console  | 
 | 32 | +   export NVIDIA_API_KEY="nvapi-*"  | 
 | 33 | +   ```  | 
 | 34 | + | 
 | 35 | +   If you don't already have an API key, visit the [NVIDIA API Catalog](https://build.ngc.nvidia.com/explore/), select on any model, then click on `Get API Key`.  | 
 | 36 | + | 
 | 37 | +1. Run the example using Streamlit:  | 
 | 38 | + | 
 | 39 | +   ```console  | 
 | 40 | +   streamlit run community/5_mins_rag_no_gpu/main.py  | 
 | 41 | +   ```  | 
 | 42 | + | 
 | 43 | +1. Test the deployed example by going to `http://<host_ip>:8501` in a web browser.  | 
 | 44 | + | 
 | 45 | +   Click **Browse Files** and select your knowledge source.  | 
 | 46 | +   After selecting, click **Upload!** to complete the ingestion process.  | 
 | 47 | + | 
 | 48 | +You are all set now! Try out queries related to the knowledge base using text from the user interface.  | 
0 commit comments