feat: implement workspace management and persistence system with multi-storage support

Author: Marvin Zhang

.devlog/entries/257-test-docker-development-environment.json

@@ -0,0 +1,32 @@
+{
+  "id": 257,
+  "key": "test-docker-development-environment",
+  "title": "Test Docker Development Environment",
+  "type": "task",
+  "description": "Testing the Docker development environment setup to ensure it works correctly for development workflow.",
+  "status": "new",
+  "priority": "medium",
+  "createdAt": "2025-07-24T04:18:45.543Z",
+  "updatedAt": "2025-07-24T04:19:34.049Z",
+  "notes": [],
+  "files": [],
+  "relatedDevlogs": [],
+  "context": {
+    "businessContext": "",
+    "technicalContext": "",
+    "dependencies": [],
+    "decisions": [],
+    "acceptanceCriteria": [],
+    "risks": []
+  },
+  "aiContext": {
+    "currentSummary": "",
+    "keyInsights": [],
+    "openQuestions": [],
+    "relatedPatterns": [],
+    "suggestedNextSteps": [],
+    "lastAIUpdate": "2025-07-24T04:18:45.543Z",
+    "contextVersion": 1
+  },
+  "archived": true
+}

.github/copilot-instructions.md

@@ -200,34 +200,38 @@ For every significant architectural change:
 
 #### Build vs Dev Server Conflicts
 - **Use `pnpm build:test` for AI testing**: When AI agents need to test builds, always use `pnpm build:test` instead of `pnpm build`
-- **Why this matters**: `pnpm build` overwrites `.next/` directory and breaks active `dev:web` servers
+- **Why this matters**: `pnpm build` overwrites `.next/` directory and breaks active development servers
 - **Solution implemented**: 
   - `pnpm build:test` uses `.next-build/` directory (separate from dev server's `.next/`)
   - Dev servers can run concurrently with build testing
   - No workflow disruption when testing build success
 - **Commands available**:
-  - `pnpm dev:web` - Runs dev server using `.next/` directory
+  - `docker compose -f docker-compose.dev.yml up web-dev` - Runs containerized dev server
   - `pnpm build:test` - Tests build using `.next-build/` directory  
   - `pnpm build` - Production build (still uses `.next/` by default)
 
-#### Single Dev Server Policy
-- **One server at a time**: `pnpm dev:web` uses fixed port 3000 and will fail if port is occupied
-- **Clear feedback**: Shows existing servers before attempting to start new one
-- **Preserve hot reload**: Don't kill existing servers - let developers use the running one
-- **Error handling**: Next.js EADDRINUSE error clearly indicates when port 3000 is busy
-- **Check existing servers**: The dev command shows what's running on ports 3000-3002 before starting
+#### Docker-Based Development Policy
+- **Use Docker Compose for development**: The development environment now runs in containers for consistency
+- **Configurable storage**: Storage type determined by `.env` file configuration (PostgreSQL, SQLite, JSON, or GitHub)
+- **Hot reloading preserved**: Volume mounts ensure code changes trigger hot reloads
+- **Port management**: Docker handles port allocation and prevents conflicts
+- **Environment isolation**: Development dependencies are containerized
+- **Commands**:
+  - Start: `docker compose -f docker-compose.dev.yml up web-dev`
+  - Stop: `docker compose -f docker-compose.dev.yml down`
+  - Logs: `docker compose logs web-dev -f`
 
 #### UI-Related Development Tasks
 - **ALWAYS use Playwright**: Use Playwright MCP tools for UI validation and debugging
 - **Browser Tool Selection**:
   - **Playwright**: Required for React error debugging, console monitoring, state analysis
   - **Simple Browser**: Basic navigation/UI testing only - NOT reliable for error detection
 - **Testing Steps**:
-  - **Start Web App**: Run `pnpm dev:web` to start the web app
-  - **Verify**: Ensure the web app is running correctly before testing
+  - **Start Web App**: Run `docker compose -f docker-compose.dev.yml up web-dev` to start the containerized web app
+  - **Verify**: Ensure the web app is running correctly before testing (check http://localhost:3200)
   - **Run Tests**: Use Playwright to run UI tests against the web app
   - **Update Devlog**: Add test results and any fixes to the devlog entry
-  - **Stop Web App**: After testing, stop the web app with `Ctrl+C` in the terminal
+  - **Stop Web App**: After testing, stop with `docker compose -f docker-compose.dev.yml down`
 
 #### React Debugging Verification Protocol
 - **MANDATORY for React Issues**: Use Playwright console monitoring before concluding any fix

Dockerfile.dev

@@ -28,6 +28,9 @@ RUN --mount=type=cache,id=pnpm,target=/pnpm/store pnpm install
 COPY packages ./packages
 COPY tsconfig.json ./
 
+# Copy scripts directory for development utilities
+COPY scripts ./scripts
+
 # Development environment
 ENV NODE_ENV=development
 ENV NEXT_TELEMETRY_DISABLED=1

docker-compose.dev.yml

@@ -10,21 +10,16 @@ services:
     container_name: devlog-web-dev
     command: pnpm dev:web
     ports:
-      - "3000:3000"
+      - "3200:3000"
     volumes:
       - .:/app
       - /app/node_modules
       - /app/packages/web/.next
       - /app/packages/web/.next-build
-    environment:
-      - NODE_ENV=development
-      - POSTGRES_URL=postgresql://postgres:postgres@postgres:5432/devlog
-      - DEVLOG_STORAGE_TYPE=postgres
-      - POSTGRES_SSL=false
-      - NEXT_TELEMETRY_DISABLED=1
-    depends_on:
-      postgres:
-        condition: service_healthy
+      - './scripts:/app/scripts'
+      - './.devlog:/app/.devlog'
+    env_file:
+      - .env
 
   # SQLite for local development (alternative to postgres)
   sqlite-dev:

docker-compose.yml

@@ -35,28 +35,14 @@ services:
       - NEXT_TELEMETRY_DISABLED=1
       - PORT=3000
     ports:
-      - "3000:3000"
+      - "3100:3000"
     depends_on:
       postgres:
         condition: service_healthy
     restart: unless-stopped
     networks:
       - devlog-network
 
-  # Redis for caching (optional)
-  redis:
-    image: redis:7-alpine
-    container_name: devlog-redis
-    ports:
-      - "6379:6379"
-    volumes:
-      - redis_data:/data
-    restart: unless-stopped
-    networks:
-      - devlog-network
-    profiles:
-      - with-cache
-
 networks:
   devlog-network:
     driver: bridge