Skip to content

Commit f4f4b7b

Browse files
authored
Merge pull request #47 from nidhigaonkar/showcase-monday
Showcase: Monday - Sonar API hackathon project
2 parents c0f3574 + dc455e6 commit f4f4b7b

File tree

1 file changed

+77
-0
lines changed

1 file changed

+77
-0
lines changed

docs/showcase/monday.mdx

Lines changed: 77 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,77 @@
1+
---
2+
title: Monday – Voice-First AI Learning Assistant
3+
description: An accessible, multimodal AI learning companion that delivers contextual reasoning, 3D visualizations, and curated educational content via natural voice interaction.
4+
sidebar_position: 9
5+
keywords: [monday, AI, VR, education, accessibility, voice-assistant, 3D-visualization, multimodal-learning, perplexity, elevenlabs]
6+
---
7+
8+
**Monday** is a voice-enabled AI learning companion designed to bridge the gap between natural language queries and high-quality educational content. Inspired by Marvel's JARVIS and FRIDAY, Monday delivers tailored responses in three modes—Basic, Reasoning, and Deep Research—while integrating immersive visualizations, curated video content, and accessibility-first design.
9+
10+
## Features
11+
12+
* **Three Learning Modes**: Basic factual answers, step-by-step reasoning, and deep research investigations
13+
* **Voice-first interaction** for hands-free learning with natural language processing
14+
* **Real-time 3D visualizations** of concepts using Three.js & WebXR
15+
* **Curated educational YouTube video integration** from trusted sources
16+
* **Multi-modal feedback** combining text, speech (via ElevenLabs), and spatial panels
17+
* **VR-optional design** for immersive experiences without requiring a headset
18+
* **Accessibility-focused interface** for mobility- and vision-impaired users
19+
20+
## Prerequisites
21+
22+
* Node.js 18 LTS or newer
23+
* Modern web browser (Chrome, Edge, or Firefox recommended)
24+
* Microphone for voice interaction
25+
* Optional: VR headset for immersive mode (WebXR compatible)
26+
* Perplexity API key, ElevenLabs API key, and YouTube API key
27+
28+
## Installation
29+
30+
```bash
31+
# Clone the repository
32+
git clone https://github.com/srivastavanik/monday.git
33+
cd monday
34+
git checkout final
35+
cd nidsmonday
36+
37+
# Install dependencies
38+
npm install
39+
40+
# Create a .env file and set your API keys
41+
PERPLEXITY_API_KEY=your_api_key
42+
ELEVENLABS_API_KEY=your_api_key
43+
YOUTUBE_API_KEY=your_api_key
44+
45+
# Start Backend Server
46+
node backend-server.js
47+
48+
# Start frontend
49+
npm run dev
50+
```
51+
52+
## Usage
53+
54+
1. Launch the app in your browser
55+
2. Say **"Hey Monday"** to activate the assistant
56+
3. Ask a question in one of three modes:
57+
- **Basic Mode** – "What is photosynthesis?"
58+
- **Reasoning Mode** – "Think about how blockchain works."
59+
- **Deep Research Mode** – "Research into the history of quantum mechanics."
60+
4. View answers as floating text panels, voice responses, and interactive 3D models
61+
62+
## Code Explanation
63+
64+
* **Frontend**: TypeScript with Three.js for 3D visualizations and WebXR for VR support
65+
* **Backend**: Node.js with Socket.IO for real-time voice command processing
66+
* **AI Integration**: Perplexity Sonar API for intelligent responses with reasoning extraction
67+
* **Voice Processing**: ElevenLabs for speech synthesis and natural language understanding
68+
* **Content Curation**: YouTube API integration with smart keyword extraction for educational videos
69+
* **Accessibility**: Voice-first design with spatial audio and haptic feedback support
70+
71+
## Links
72+
73+
- [GitHub Repository](https://github.com/srivastavanik/monday/tree/final)
74+
- [Live Demo](https://www.youtube.com/watch?v=BSN3Wp4uE-U)
75+
76+
77+

0 commit comments

Comments
 (0)