AI-powered medical assistant with real-time voice conversation capabilities
Carex AI is a cutting-edge medical consultation platform that leverages artificial intelligence to provide real-time voice conversations with specialized medical AI agents. Built with modern web technologies, it offers an intuitive interface for users to discuss health concerns and receive AI-powered medical guidance.
- Advanced speech recognition using AssemblyAI
- Natural turn-taking conversation flow
- High-accuracy voice-to-text conversion
- Seamless audio processing
- Multiple AI doctor agents with different specializations
- Comprehensive medical knowledge base
- Context-aware responses
- Personalized consultation experience
- Immersive 3D scenes using Spline
- Visual medical consultations
- Engaging user interface
- Modern design aesthetics
- Clerk-powered user authentication
- Secure session management
- User profile management
- Privacy-focused design
- Complete consultation history
- Session tracking and analytics
- Progress monitoring
- Data persistence
- Next.js 15.3.4 - React framework with App Router
- React 19.0.0 - UI library
- TypeScript 5.0 - Type safety
- Tailwind CSS 4.0 - Utility-first CSS framework
- Framer Motion - Animation library
- Radix UI - Accessible component primitives
- OpenAI/OpenRouter - AI conversation engine
- AssemblyAI - Speech-to-text processing
- Murf AI - Text-to-speech synthesis
- Socket.IO - Real-time communication
- Prisma 6.10.1 - Database toolkit
- PostgreSQL - Primary database
- SQLite - Development database
- Clerk - User authentication
- Next.js Middleware - Route protection
- JWT - Session management
- ESLint - Code linting
- Prettier - Code formatting
- Bun - Package manager & runtime
- Turbopack - Fast bundler
carex-ai/
βββ π app/ # Next.js App Router
β βββ π (auth)/ # Authentication routes
β β βββ sign-in/ # Sign in pages
β β βββ sign-up/ # Sign up pages
β βββ π (routes)/ # Protected routes
β β βββ dashboard/ # Main dashboard
β β βββ π _components/ # Dashboard components
β β β βββ AppHeader.tsx # Dashboard header
β β β βββ AddNewSession.tsx # Session creation
β β β βββ DoctorsList.tsx # AI doctors list
β β β βββ HistoryList.tsx # Session history
β β β βββ drawer.tsx # Mobile navigation
β β βββ π medical-agent/ # Voice conversation
β β βββ π [sessionId]/ # Dynamic session pages
β β βββ π components/ # Voice components
β β β βββ AudioProcessor.tsx
β β β βββ ConversationManager.tsx
β β β βββ TextToSpeech.tsx
β β β βββ VoiceRecordButton.tsx
β β βββ π services/ # API services
β βββ π api/ # API routes
β β βββ chat/ # Chat endpoints
β β βββ session-chat/ # Session management
β β βββ suggest-doctors/ # Doctor suggestions
β β βββ transcribe/ # Speech transcription
β β βββ tts/ # Text-to-speech
β β βββ users/ # User management
β βββ globals.css # Global styles
β βββ layout.tsx # Root layout
β βββ page.tsx # Home page
β βββ provider.tsx # Context providers
βββ π components/ # Shared components
β βββ π ui/ # UI components
β β βββ button.tsx
β β βββ dialog.tsx
β β βββ input.tsx
β β βββ ...
β βββ π sections/ # Page sections
β β βββ header.tsx
β β βββ hero.tsx
β β βββ features.tsx
β β βββ pricing.tsx
β β βββ ...
β βββ π magicui/ # Advanced UI components
βββ π lib/ # Utility libraries
β βββ π hooks/ # Custom hooks
β βββ π generated/ # Generated files
β βββ config.tsx # App configuration
β βββ utils.ts # Utility functions
βββ π prisma/ # Database schema
β βββ schema.prisma # Database schema
β βββ π migrations/ # Database migrations
βββ π public/ # Static assets
β βββ π fonts/ # Custom fonts
β βββ carex.splinecode # 3D scene file
β βββ ... # Images and icons
βββ π context/ # React contexts
βββ π shared/ # Shared utilities
βββ middleware.ts # Next.js middleware
βββ next.config.ts # Next.js configuration
βββ tailwind.config.ts # Tailwind configuration
βββ tsconfig.json # TypeScript configuration
βββ package.json # Dependencies
- Node.js 18+ or Bun
- PostgreSQL database
- API keys for external services
-
Clone the repository
git clone https://github.com/your-username/carex-ai.git cd carex-ai -
Install dependencies
# Using Bun (recommended) bun install # Or using npm npm install
-
Set up environment variables
cp .env.example .env.local
Fill in your environment variables:
# Database DATABASE_URL="postgresql://username:password@localhost:5432/carex_ai" # Authentication (Clerk) NEXT_PUBLIC_CLERK_PUBLISHABLE_KEY=your_clerk_publishable_key CLERK_SECRET_KEY=your_clerk_secret_key # AI Services GOOGLE_API_KEY=your_google_api_key_here OPEN_ROUTER_API_KEY=your_openrouter_api_key NEXT_PUBLIC_ASSEMBLYAI_API_KEY=your_assemblyai_api_key MURF_API_KEY=your_murf_api_key # App Configuration NEXT_PUBLIC_APP_URL=http://localhost:3000
-
Set up the database
# Generate Prisma client bun run prisma generate # Run migrations bun run prisma migrate dev
-
Start the development server
bun run dev
-
Open your browser Navigate to http://localhost:3000
- Sign up/Login - Create an account or sign in
- Choose a Doctor - Select from available AI medical specialists
- Start Consultation - Begin a voice conversation
- Speak Naturally - Discuss your health concerns
- Review History - Access past consultations
- API Integration - Use the provided API endpoints
- Custom Components - Extend the UI components
- Database Schema - Modify Prisma schema as needed
- AI Models - Integrate different AI providers
User Speech β AssemblyAI β Text β OpenAI β Response β Murf AI β Audio
- Real-time tracking of conversation progress
- Automatic session creation and management
- Persistent storage of consultation data
- User-specific history and analytics
- Cardiology - Heart and cardiovascular health
- Neurology - Brain and nervous system
- Dermatology - Skin conditions
- Pediatrics - Child health
- General Medicine - General health concerns
- End-to-end encryption for voice conversations
- Secure API endpoints with authentication
- Data privacy compliance (GDPR, HIPAA-ready)
- Regular security audits and updates
- User data protection and anonymization
We welcome contributions! Please see our Contributing Guidelines for details.
- Fork the repository
- Create a feature branch (
git checkout -b feature/amazing-feature) - Commit your changes (
git commit -m 'Add amazing feature') - Push to the branch (
git push origin feature/amazing-feature) - Open a Pull Request
This project is licensed under the MIT License - see the LICENSE file for details.
- Team Falcons - Development team
- OpenAI - AI conversation capabilities
- AssemblyAI - Speech recognition technology
- Clerk - Authentication services
- Spline - 3D design tools
- Documentation: docs.carex-ai.com
- Issues: GitHub Issues
- Discord: Join our community
- Email: support@carex-ai.com
# Install Vercel CLI
npm i -g vercel
# Deploy
vercel# Build image
docker build -t carex-ai .
# Run container
docker run -p 3000:3000 carex-aiMade with β€οΈ by Team Falcons