Skip to content

Add Classroom Life to showcase#68

Open
elhould wants to merge 2 commits intoelevenlabs:mainfrom
elhould:main
Open

Add Classroom Life to showcase#68
elhould wants to merge 2 commits intoelevenlabs:mainfrom
elhould:main

Conversation

@elhould
Copy link
Copy Markdown

@elhould elhould commented Jan 19, 2026

Summary

Adds Classroom Life - an AI-powered 3D classroom simulation that diagnoses student understanding and provides personalized tutoring with voice interaction.

🏆 Winner of the Agent Olympics Hackathon 2026 "Best use of ElevenLabs" Challenge

Project Highlights

Classroom Life features an immersive 3D classroom environment where an AI tutor interacts with simulated students. The system uses a two-phase approach:

  • Diagnostic Phase (turns 1-5): Strategic conversations to gauge each student's understanding level without teaching
  • Tutoring Phase (turns 6-10): Personalized instruction adapted to the diagnosed mastery level (1-5)

Key Features

  • Adaptive AI Tutoring: 10-turn conversations with LLM-based understanding assessment using educational rubrics
  • Immersive Voice Experience: Each student has a unique ElevenLabs voice matching their personality (shy, confident, anxious, etc.)
  • Voice Input for Tutors: Speak your tutoring responses using ElevenLabs speech-to-text
  • 3D Classroom Visualization: Interactive React Three Fiber scene with speech bubbles synced to audio playback
  • Educational Image Generation: AI-generated visual aids displayed on the classroom monitor
  • Student Personalities: Simulated students with distinct personalities (easily distracted, perfectionist, unmotivated, overconfident, shy)

ElevenLabs Integration

  • Text-to-Speech: Uses eleven_multilingual_v2 with 6 distinct voice configurations, each with per-character voice settings (stability, similarity boost) to create unique student personalities
  • Speech-to-Text: Uses scribe_v2 for voice input transcription, enabling tutors to speak their responses naturally

Project Links

Technologies Used

  • ElevenLabs API (TTS with eleven_multilingual_v2, STS with scribe_v2)
  • OpenAI (GPT-4o-mini for student simulation, tutor responses, and level prediction; gpt-image-1-mini for educational illustrations)
  • React Three Fiber for 3D classroom rendering
  • React + TypeScript + Vite
  • Express.js backend
  • Tailwind CSS + shadcn/ui

Rights Confirmation

I confirm that I have the rights to share this project publicly.

Social Media

  • X/Twitter Handle: @yesoktheyknow

@vercel
Copy link
Copy Markdown
Contributor

vercel bot commented Jan 19, 2026

@elhould is attempting to deploy a commit to the ElevenLabs Team on Vercel.

A member of the Team first needs to authorize it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant