DreamTracer Backend Progress Tracker

Overview

Backend implementation for AI-powered dream analysis with Inngest workflows, permanent sandbox IDs, and comprehensive pattern recognition.

Core Requirements

1. Individual Dream Analysis (On Save)

Trigger: When user hits "Save" button after journal entry Process:

Create permanent sandbox ID
OpenAI agent analyzes single dream
Generate personalized response (funny remarks, jokes, recommendations)
Store analysis results in database

2. Pattern Analysis (Manual Trigger)

Trigger: Button click on patterns page Process:

Create permanent sandbox ID
OpenAI agent analyzes ALL journal entries
Find patterns across dreams
Generate comprehensive insights and recommendations
Store pattern analysis in database

Implementation Progress

Phase 1: Inngest Setup & Configuration ✅

Phase 2: Individual Dream Analysis Workflow ✅

Phase 3: Pattern Analysis Workflow ✅

Phase 4: Database Optimization 🔄

Phase 5: AI Enhancement & Personalization 🔄

Phase 6: Error Handling & Monitoring 🔄

Technical Implementation Details

Inngest Job Definitions

1. Individual Dream Analysis Job

// File: src/lib/inngest-jobs/dream-analysis.ts
export const dreamAnalysisJob = inngest.createFunction(
  { id: "dream-individual-analysis" },
  { event: "dream.created" },
  async ({ event, step }) => {
    // Implementation details
  }
);

2. Pattern Analysis Job

// File: src/lib/inngest-jobs/pattern-analysis.ts
export const patternAnalysisJob = inngest.createFunction(
  { id: "dream-pattern-analysis" },
  { event: "pattern.analysis.requested" },
  async ({ event, step }) => {
    // Implementation details
  }
);

Database Schema Updates

Dreams Table Additions

ALTER TABLE dreams ADD COLUMN sandbox_id UUID;
ALTER TABLE dreams ADD COLUMN processing_status VARCHAR(50) DEFAULT 'pending';
CREATE INDEX idx_dreams_sandbox_id ON dreams(sandbox_id);
CREATE INDEX idx_dreams_processing_status ON dreams(processing_status);

Analysis Tracking Table

CREATE TABLE analysis_jobs (
  id UUID PRIMARY KEY DEFAULT gen_random_uuid(),
  user_id VARCHAR(255) NOT NULL,
  job_type VARCHAR(50) NOT NULL, -- 'individual' or 'pattern'
  sandbox_id UUID NOT NULL,
  status VARCHAR(50) DEFAULT 'running',
  created_at TIMESTAMP DEFAULT NOW(),
  completed_at TIMESTAMP,
  error_message TEXT
);

API Endpoints

Enhanced Dreams API

POST /api/dreams - Save dream + trigger analysis
GET /api/dreams/[id]/analysis-status - Check processing status

Pattern Analysis API

POST /api/patterns/analyze - Trigger pattern analysis
GET /api/patterns/analysis-status/[jobId] - Check status

AI Prompt Templates

Individual Dream Analysis Prompt

const INDIVIDUAL_ANALYSIS_PROMPT = `
You are a friendly AI dream analyst with a sense of humor. 
Analyze this dream and provide:
1. Light-hearted observations or funny remarks if appropriate
2. Personalized recommendations based on dream content
3. Emotional insights
4. Symbolic interpretations

Dream: {dreamContent}
Context: {userContext}
`;

Pattern Analysis Prompt

const PATTERN_ANALYSIS_PROMPT = `
You are an expert dream pattern analyst. 
Analyze all dreams and provide:
1. Recurring themes and their significance
2. Emotional patterns over time
3. Sleep quality correlations
4. Wellness recommendations
5. Behavioral insights

Dreams: {allDreams}
User Profile: {userProfile}
`;

Testing Strategy

Unit Tests

Test individual job functions
Test AI prompt generation
Test database operations
Test error handling

Integration Tests

Test full workflow end-to-end
Test Inngest job execution
Test database transactions
Test API endpoints

Performance Tests

Test with large dream datasets
Test concurrent job processing
Test OpenAI API rate limits
Test database query performance

Deployment Checklist

Development Environment

Inngest dev server running
Database migrations applied
Environment variables configured
OpenAI API key configured

Production Readiness

Inngest production setup
Database backup procedures
Error monitoring configured
Performance monitoring setup

Success Metrics

Functional Requirements

Dreams analyzed within 30 seconds of saving
Pattern analysis completes within 2 minutes
99% job success rate
Meaningful and humorous AI responses

Performance Requirements

Handle 100+ concurrent dream analyses
Process 1000+ dreams for pattern analysis
Sub-second API response times
Efficient database queries

Next Steps

Immediate: Set up Inngest development environment
Week 1: Implement individual dream analysis workflow
Week 2: Implement pattern analysis workflow
Week 3: AI prompt optimization and testing
Week 4: Performance optimization and monitoring

Notes

All sandbox IDs must be permanent and persistent
AI responses should be personalized and contextual
Error handling must be comprehensive
Performance must scale with user growth
User experience should be seamless and engaging

Status: Phase 1 & 2 & 3 Complete - Ready for Database Migration and Testing Last Updated: July 7, 2025

🚨 NEXT ACTION REQUIRED: Database Migration

Before testing, you must run the database migration manually in Supabase. See: DATABASE_MIGRATION_INSTRUCTIONS.md for detailed steps.

✅ What's Working Now:

Individual Dream Analysis: When you save a dream, it will:
- Generate a permanent sandbox ID
- Trigger background AI analysis with Dr. DreamBot
- Provide humorous observations and recommendations
- Store results in the database
Pattern Analysis: When you click "New AI Analysis":
- Analyze ALL your dreams for patterns
- Generate comprehensive wellness insights
- Provide personalized recommendations
- Track analysis progress
Inngest Integration: Both servers running:
- Next.js dev server: http://localhost:3001
- Inngest dev server: http://localhost:8288

FilesExpand file tree

BACKEND_PROGRESS_TRACKER.md

Latest commit

History