Commit 891ba0d
Implement full multimodal EmpathyLab with Hume + Human integration
## Features
- Multimodal emotion detection: facial (Human) + vocal (Hume EVI)
- Created 3 new components: HumeVoiceChat, EmotionFusionDisplay, GazeOverlay
- Purple wave animations (#6e42cc) for Hume listening indicator
- Eye gaze tracking overlay with bearing/strength visualization
- Emotion fusion with conflict detection (polarity mismatch, suppressed anxiety)
## Advanced Human Library
- Result interpolation via human.next() for smoother detection
- Real-time FPS monitoring (30-frame rolling average)
- TensorFlow tensor memory tracking
- Enhanced config: minConfidence, maxDetected, warmup, async
- Performance stats in UI: FPS + tensor count
## Session Storage
- 4 API endpoints: POST/GET/DELETE /api/empathylab/sessions
- In-memory Map storage (MongoDB-ready schema)
- Save Session and Export JSON buttons
- Session metadata: duration, dataPoints, avgFps, emotions
## Orchestrator Context
- Added comprehensive EmpathyLab documentation
- 7 facial emotions + 48 voice emotions
- Gaze tracking, multimodal fusion, use cases
- Privacy-first: all CV processing local in browser
## Fixes
- Fixed server.js duplicate variable declaration
- Updated Vite config COOP headers to 'same-origin-allow-popups'
- Improved error handling and type normalization
## Storybook
- Added Planner sidebar stories (PlannerSidebar, DraggableItem)
- Created reusable SidebarItemCard and SidebarToggleItemCard
- Added Material Symbols font to preview-head
🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude <noreply@anthropic.com>1 parent f561e98 commit 891ba0d
File tree
22 files changed
+2108
-203
lines changed- .storybook
- src
- components
- empathy
- sidebar
- data
- lib/assistant
- styles/components
22 files changed
+2108
-203
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
3 | 5 | | |
4 | 6 | | |
5 | 7 | | |
| |||
64 | 66 | | |
65 | 67 | | |
66 | 68 | | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1358 | 1358 | | |
1359 | 1359 | | |
1360 | 1360 | | |
1361 | | - | |
| 1361 | + | |
1362 | 1362 | | |
1363 | 1363 | | |
1364 | 1364 | | |
1365 | | - | |
| 1365 | + | |
| 1366 | + | |
| 1367 | + | |
| 1368 | + | |
| 1369 | + | |
| 1370 | + | |
| 1371 | + | |
| 1372 | + | |
1366 | 1373 | | |
1367 | 1374 | | |
1368 | 1375 | | |
| |||
1442 | 1449 | | |
1443 | 1450 | | |
1444 | 1451 | | |
| 1452 | + | |
| 1453 | + | |
| 1454 | + | |
| 1455 | + | |
| 1456 | + | |
| 1457 | + | |
| 1458 | + | |
| 1459 | + | |
| 1460 | + | |
| 1461 | + | |
| 1462 | + | |
| 1463 | + | |
| 1464 | + | |
| 1465 | + | |
| 1466 | + | |
| 1467 | + | |
| 1468 | + | |
| 1469 | + | |
| 1470 | + | |
| 1471 | + | |
| 1472 | + | |
| 1473 | + | |
| 1474 | + | |
| 1475 | + | |
| 1476 | + | |
| 1477 | + | |
| 1478 | + | |
| 1479 | + | |
| 1480 | + | |
| 1481 | + | |
| 1482 | + | |
| 1483 | + | |
| 1484 | + | |
| 1485 | + | |
| 1486 | + | |
| 1487 | + | |
| 1488 | + | |
| 1489 | + | |
| 1490 | + | |
| 1491 | + | |
| 1492 | + | |
| 1493 | + | |
| 1494 | + | |
| 1495 | + | |
| 1496 | + | |
| 1497 | + | |
| 1498 | + | |
| 1499 | + | |
| 1500 | + | |
| 1501 | + | |
| 1502 | + | |
| 1503 | + | |
| 1504 | + | |
| 1505 | + | |
| 1506 | + | |
| 1507 | + | |
| 1508 | + | |
| 1509 | + | |
| 1510 | + | |
| 1511 | + | |
| 1512 | + | |
| 1513 | + | |
| 1514 | + | |
| 1515 | + | |
| 1516 | + | |
| 1517 | + | |
| 1518 | + | |
| 1519 | + | |
| 1520 | + | |
| 1521 | + | |
| 1522 | + | |
| 1523 | + | |
| 1524 | + | |
| 1525 | + | |
| 1526 | + | |
| 1527 | + | |
| 1528 | + | |
| 1529 | + | |
| 1530 | + | |
| 1531 | + | |
| 1532 | + | |
| 1533 | + | |
| 1534 | + | |
| 1535 | + | |
| 1536 | + | |
| 1537 | + | |
| 1538 | + | |
| 1539 | + | |
| 1540 | + | |
| 1541 | + | |
| 1542 | + | |
| 1543 | + | |
| 1544 | + | |
| 1545 | + | |
| 1546 | + | |
| 1547 | + | |
| 1548 | + | |
| 1549 | + | |
| 1550 | + | |
| 1551 | + | |
| 1552 | + | |
| 1553 | + | |
| 1554 | + | |
| 1555 | + | |
| 1556 | + | |
1445 | 1557 | | |
1446 | 1558 | | |
1447 | 1559 | | |
| |||
0 commit comments