|
| 1 | +--- |
| 2 | +title: Monday – Voice-First AI Learning Assistant |
| 3 | +description: An accessible, multimodal AI learning companion that delivers contextual reasoning, 3D visualizations, and curated educational content via natural voice interaction. |
| 4 | +sidebar_position: 9 |
| 5 | +keywords: [monday, AI, VR, education, accessibility, voice-assistant, 3D-visualization, multimodal-learning, perplexity, elevenlabs] |
| 6 | +--- |
| 7 | + |
| 8 | +**Monday** is a voice-enabled AI learning companion designed to bridge the gap between natural language queries and high-quality educational content. Inspired by Marvel's JARVIS and FRIDAY, Monday delivers tailored responses in three modes—Basic, Reasoning, and Deep Research—while integrating immersive visualizations, curated video content, and accessibility-first design. |
| 9 | + |
| 10 | +## Features |
| 11 | + |
| 12 | +* **Three Learning Modes**: Basic factual answers, step-by-step reasoning, and deep research investigations |
| 13 | +* **Voice-first interaction** for hands-free learning with natural language processing |
| 14 | +* **Real-time 3D visualizations** of concepts using Three.js & WebXR |
| 15 | +* **Curated educational YouTube video integration** from trusted sources |
| 16 | +* **Multi-modal feedback** combining text, speech (via ElevenLabs), and spatial panels |
| 17 | +* **VR-optional design** for immersive experiences without requiring a headset |
| 18 | +* **Accessibility-focused interface** for mobility- and vision-impaired users |
| 19 | + |
| 20 | +## Prerequisites |
| 21 | + |
| 22 | +* Node.js 18 LTS or newer |
| 23 | +* Modern web browser (Chrome, Edge, or Firefox recommended) |
| 24 | +* Microphone for voice interaction |
| 25 | +* Optional: VR headset for immersive mode (WebXR compatible) |
| 26 | +* Perplexity API key, ElevenLabs API key, and YouTube API key |
| 27 | + |
| 28 | +## Installation |
| 29 | + |
| 30 | +```bash |
| 31 | +# Clone the repository |
| 32 | +git clone https://github.com/srivastavanik/monday.git |
| 33 | +cd monday |
| 34 | +git checkout final |
| 35 | +cd nidsmonday |
| 36 | + |
| 37 | +# Install dependencies |
| 38 | +npm install |
| 39 | + |
| 40 | +# Create a .env file and set your API keys |
| 41 | +PERPLEXITY_API_KEY=your_api_key |
| 42 | +ELEVENLABS_API_KEY=your_api_key |
| 43 | +YOUTUBE_API_KEY=your_api_key |
| 44 | + |
| 45 | +# Start Backend Server |
| 46 | +node backend-server.js |
| 47 | + |
| 48 | +# Start frontend |
| 49 | +npm run dev |
| 50 | +``` |
| 51 | + |
| 52 | +## Usage |
| 53 | + |
| 54 | +1. Launch the app in your browser |
| 55 | +2. Say **"Hey Monday"** to activate the assistant |
| 56 | +3. Ask a question in one of three modes: |
| 57 | + - **Basic Mode** – "What is photosynthesis?" |
| 58 | + - **Reasoning Mode** – "Think about how blockchain works." |
| 59 | + - **Deep Research Mode** – "Research into the history of quantum mechanics." |
| 60 | +4. View answers as floating text panels, voice responses, and interactive 3D models |
| 61 | + |
| 62 | +## Code Explanation |
| 63 | + |
| 64 | +* **Frontend**: TypeScript with Three.js for 3D visualizations and WebXR for VR support |
| 65 | +* **Backend**: Node.js with Socket.IO for real-time voice command processing |
| 66 | +* **AI Integration**: Perplexity Sonar API for intelligent responses with reasoning extraction |
| 67 | +* **Voice Processing**: ElevenLabs for speech synthesis and natural language understanding |
| 68 | +* **Content Curation**: YouTube API integration with smart keyword extraction for educational videos |
| 69 | +* **Accessibility**: Voice-first design with spatial audio and haptic feedback support |
| 70 | + |
| 71 | +## Links |
| 72 | + |
| 73 | +- [GitHub Repository](https://github.com/srivastavanik/monday/tree/final) |
| 74 | +- [Live Demo](https://www.youtube.com/watch?v=BSN3Wp4uE-U) |
| 75 | + |
| 76 | + |
| 77 | + |
0 commit comments