Skip to content

davidagustin/spell-your-name

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

13 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐ŸคŸ Sign Language Learning App

Learn to spell your name in American Sign Language with real-time AI-powered hand tracking

Live Demo GitHub Tech Stack

Next.js 15.4.5 React 19 TypeScript Tailwind CSS MediaPipe Hands

โœจ Features

๐ŸŽฏ Interactive Learning Experience

  • Personalized Learning: Enter your name and learn to spell it letter by letter
  • Real-time Feedback: Instant AI-powered gesture recognition and feedback
  • Visual Progress Tracking: See your progress through each letter of your name
  • Hand Stability Detection: AI monitors hand steadiness for better accuracy

๐Ÿค– Advanced AI Technology

  • Computer Vision: Real-time hand tracking using MediaPipe Hands API
  • Finger State Detection: Precise open/closed finger state recognition
  • Visual Hand Tracking: Color-coded landmarks and connections (green=open, red=closed)
  • Smart Recognition: Circle-based detection with stability validation

๐ŸŽจ Beautiful User Interface

  • Modern Design: Clean, responsive interface with smooth animations
  • Visual Guides: Clear hand positioning guides and target indicators
  • Real-time Feedback: Color-coded status indicators and progress bars
  • Full Screen Mode: YouTube-style full screen button for immersive experience
  • Accessibility: High contrast design and clear visual cues

๐Ÿ“š Comprehensive Learning Tools

  • ASL Alphabet Guide: Complete reference with visual hand sign images
  • Step-by-Step Instructions: Clear guidance for each letter
  • Practice Mode: Repeat letters until you master them
  • Achievement System: Celebrate completion with congratulations screen

๐Ÿš€ Live Demo

Experience the app right now:

Try the App

What you'll experience:

  • โœจ Real-time hand gesture recognition
  • ๐Ÿค– AI-powered feedback and analysis
  • ๐Ÿ“ฑ Responsive design that works on all devices
  • ๐ŸŽฏ Interactive learning with visual guides
  • ๐Ÿ† Progress tracking and completion celebration
  • โšก Optimized performance with clean, efficient code

๐Ÿ› ๏ธ Technology Stack

Frontend Framework

  • Next.js 15.4.5 - React framework with App Router
  • React 19 - Latest React with concurrent features
  • TypeScript 5 - Type-safe development

Styling & UI

  • Tailwind CSS - Utility-first CSS framework
  • Responsive Design - Mobile-first approach
  • Smooth Animations - CSS transitions and transforms

Computer Vision & AI

  • MediaPipe Hands - Real-time hand tracking API
  • Custom Gesture Recognition - Advanced ASL pattern matching
  • 3D Coordinate Analysis - Precise finger position detection
  • Optimized Performance - Clean, efficient codebase

Development Tools

  • ESLint - Code quality and consistency
  • PostCSS - CSS processing
  • Vercel - Deployment and hosting

๐Ÿ“ฆ Installation & Setup

Prerequisites

  • Node.js 18+
  • npm or yarn
  • Modern web browser with camera access

Quick Start

  1. Clone the repository

    git clone https://github.com/davidagustin/spell-your-name.git
    cd spell-your-name
  2. Install dependencies

    npm install
    # or
    yarn install
  3. Start the development server

    npm run dev
    # or
    yarn dev
  4. Open your browser

    Navigate to http://localhost:3000
    

Environment Setup

No environment variables required! The app works out of the box with:

  • Camera permissions (granted by user)
  • Internet connection (for MediaPipe CDN)

๐ŸŽฎ How to Use

Getting Started

  1. Enter Your Name: Type your name in the input field
  2. Grant Camera Access: Allow camera permissions when prompted
  3. Position Your Hand: Place your hand in the center circle
  4. Follow the Guide: Use the ASL alphabet reference for each letter
  5. Practice & Improve: Get real-time AI feedback and tips

Learning Process

  1. Letter by Letter: Learn to spell your name one letter at a time
  2. Visual Feedback: See real-time hand tracking and gesture recognition
  3. AI Analysis: Receive detailed feedback on your hand positioning
  4. Progress Tracking: Monitor your progress through each letter
  5. Completion: Celebrate when you successfully spell your entire name!

Tips for Best Results

  • ๐Ÿ“น Good Lighting: Ensure your hand is well-lit
  • ๐Ÿ–๏ธ Clear Background: Use a plain background for better detection
  • ๐Ÿ“ Proper Distance: Keep your hand 12-18 inches from the camera
  • ๐ŸŽฏ Stay Steady: Hold your hand still for better recognition
  • ๐Ÿ”„ Practice: Repeat letters until you feel confident

๐Ÿ—๏ธ Project Structure

spell-your-name/
โ”œโ”€โ”€ app/                          # Next.js App Router
โ”‚   โ”œโ”€โ”€ components/               # React components
โ”‚   โ”‚   โ”œโ”€โ”€ CameraComponent.tsx   # Main camera & AI logic
โ”‚   โ”‚   โ”œโ”€โ”€ AlphabetGuide.tsx     # ASL alphabet reference
โ”‚   โ”‚   โ””โ”€โ”€ NameInput.tsx         # Name input component
โ”‚   โ”œโ”€โ”€ globals.css               # Global styles
โ”‚   โ”œโ”€โ”€ layout.tsx                # Root layout
โ”‚   โ””โ”€โ”€ page.tsx                  # Main page
โ”œโ”€โ”€ public/                       # Static assets
โ”‚   โ””โ”€โ”€ signs/                    # ASL hand sign images (A-Z)
โ””โ”€โ”€ package.json                  # Dependencies & scripts

๐Ÿ”ง Key Components

CameraComponent.tsx

  • Real-time hand tracking with MediaPipe
  • AI-powered gesture recognition
  • Visual feedback and progress indicators
  • Hand stability detection

AlphabetGuide.tsx

  • Complete ASL alphabet reference
  • Visual hand sign images
  • Interactive letter highlighting
  • Educational descriptions

๐ŸŽฏ Features in Detail

Real-time Hand Tracking

  • MediaPipe Integration: Advanced hand landmark detection
  • 21-Point Tracking: Precise finger and joint positioning
  • 3D Analysis: Depth-aware gesture recognition
  • Stability Monitoring: Hand movement detection

AI-Powered Recognition

  • Custom Algorithms: Tailored ASL pattern matching
  • Real-time Analysis: Instant gesture evaluation
  • Confidence Scoring: Accuracy measurement
  • Personalized Feedback: Specific improvement tips

Visual Learning Aids

  • Hand Positioning Guides: Clear visual indicators
  • Progress Tracking: Real-time completion status
  • Color-coded Feedback: Intuitive status indicators
  • Responsive Design: Works on all screen sizes

๐Ÿš€ Deployment

Vercel (Recommended)

  1. Connect Repository: Link your GitHub repo to Vercel
  2. Automatic Deployment: Push to main branch for auto-deploy
  3. Custom Domain: Add your domain (optional)

Other Platforms

  • Netlify: Compatible with Next.js
  • Railway: Easy deployment with environment variables
  • AWS Amplify: Enterprise-grade hosting

๐Ÿค Contributing

We welcome contributions! Here's how you can help:

Getting Started

  1. Fork the repository
  2. Create a feature branch: git checkout -b feature/amazing-feature
  3. Commit your changes: git commit -m 'Add amazing feature'
  4. Push to the branch: git push origin feature/amazing-feature
  5. Open a Pull Request

Areas for Contribution

  • ๐ŸŽจ UI/UX improvements
  • ๐Ÿค– AI algorithm enhancements
  • ๐Ÿ“ฑ Mobile optimization
  • ๐Ÿงน Code optimization and cleanup
  • ๐ŸŒ Internationalization
  • ๐Ÿงช Testing and bug fixes
  • ๐Ÿ“š Documentation improvements

๐Ÿ“„ License

This project is licensed under the MIT License - see the LICENSE file for details.


๐Ÿ™ Acknowledgments

  • MediaPipe Team - For the amazing hand tracking technology
  • Next.js Team - For the excellent React framework
  • Tailwind CSS - For the beautiful utility-first CSS
  • ASL Community - For preserving and sharing sign language knowledge

๐Ÿ“ž Support & Contact


Made with โค๏ธ by David Agustin

โญ Star this repository if you found it helpful!

About

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages