Skip to content

Commit f9f9668

Browse files
authored
Update README.md
1 parent 6f2dd16 commit f9f9668

File tree

1 file changed

+93
-1
lines changed

1 file changed

+93
-1
lines changed

โ€ŽREADME.mdโ€Ž

Lines changed: 93 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1,93 @@
1-
# NST-AI
1+
# ๐ŸŽ“ NST AI - Your Personal Study Companion
2+
3+
Welcome to **NST AI** โ€“ your AI-powered study buddy designed specifically for Newton School of Technologies! With NST AI, you can ask questions, summarize lectures, and interact with your notes offline using state-of-the-art language models like **Mistral 7b LLM** and **Nomic Embed Text**. Follow the steps below to set up NST AI on macOS.
4+
5+
---
6+
7+
## ๐Ÿš€ Features
8+
- ๐Ÿ’ฌ **Ask AI Anything**: Get instant answers to questions about your lectures and notes.
9+
- ๐Ÿ“‘ **Summarize Notes**: Automatically summarize classes, lectures, and key study topics.
10+
- ๐ŸŒ **Offline Access**: Access powerful LLM capabilities without an internet connection.
11+
12+
---
13+
14+
## ๐Ÿ“‹ Prerequisites
15+
Before you start, make sure the following are installed on your Mac:
16+
- ๐Ÿ **Python 3.11** [Download here](https://www.python.org/downloads/)
17+
- ๐Ÿบ **Homebrew** [Install Homebrew](https://brew.sh/)
18+
19+
---
20+
21+
## โš™๏ธ Installation Guide
22+
23+
Follow these steps to install and set up NST AI:
24+
25+
### Step 1: ๐Ÿ”„ Update Pip
26+
First, update `pip` to the latest version:
27+
28+
```
29+
pip install pip --upgrade
30+
```
31+
32+
### Step 2: ๐Ÿ“ฆ Install Poetry
33+
34+
Install Poetry to manage project dependencies:
35+
```
36+
pip install poetry
37+
poetry --version # Verify installation
38+
```
39+
### Step 3: ๐ŸŒ Install Ollama.ai
40+
41+
1. Visit Ollamaโ€™s official website and download the macOS version.
42+
2. After downloading, unzip the file, open it, and follow the instructions to move Ollama to your Applications folder.
43+
3. Important: Quit Ollama from the taskbar by selecting Quit Ollama.
44+
45+
### Step 4: ๐Ÿ“ฅ Download LLM Models
46+
47+
NST AI uses Mistral 7b LLM and Nomic Embed Text models for offline functionality. Pull these models with:
48+
```
49+
ollama pull mistral
50+
ollama pull nomic-embed-text
51+
```
52+
### Step 5: ๐Ÿ–ฅ๏ธ Start Ollama Service
53+
54+
Start the Ollama service:
55+
```
56+
ollama serve
57+
```
58+
59+
โš ๏ธ Note: If you see Error: listen tcp 127.0.0.1:11434: bind: address already in use, Ollama is already running. Close it from the taskbar and try again.
60+
61+
Step 6: ๐Ÿ› ๏ธ Install Ollama LLM with Poetry
62+
63+
In a new terminal window, install NST AIโ€™s dependencies:
64+
65+
```
66+
poetry install --extras "ui llms-ollama embeddings-ollama vector-stores-qdrant"
67+
```
68+
69+
### Step 7: ๐Ÿš€ Run NST AI
70+
71+
To start NST AI, use:
72+
73+
```
74+
PGPT_PROFILES=ollama make run
75+
```
76+
77+
Access NST AI in your browser at http://localhost:8001.
78+
79+
๐Ÿ›  Troubleshooting
80+
81+
โ€ข ๐Ÿข Slow CPU or GPU Issues:
82+
If NST AI is slow or if you experience GPU issues, modify the timeout setting:
83+
Open ```components/llm/llm_component.py``` and add:
84+
85+
```request_timeout=300```
86+
87+
88+
89+
๐ŸŽฅ Video Tutorial
90+
91+
๐ŸŒŸ Final Note
92+
93+
NST AI is here to enhance student learning at NST, making studying easier and more efficient. If you have any questions or need assistance, feel free to reach out. Enjoy exploring the world of personalized AI learning! ๐ŸŽ‰

0 commit comments

Comments
ย (0)