v1.5.0: Coding Specs, Multi-Workshop Support, CSV Upload into mlflow, multiple Judge Tuning.
🎉 Release v1.5.0
📦 Installation
Download project-with-build.zip which includes pre-built frontend assets.
Coding agent support
- Structured specs definition: better support for Claude/AI coding assistants to understand patterns
- Enables AI coding agents: quickly find relevant documentation when working on specific features.
Toggle Randomization:
- Facilitator can choose to turn on randomization of traces in discovery and annotation phase to enable participants/SMEs to see the same set of traces but in different order
- Default setting is OFF.
🏢 Multi-Workshop Support
- Isolated Workshop Data: One facilitator can create separate workshops with isolated data
- Workshop Selection: Participants/SMEs can select which workshop to join from login page
- Persistent Storage: All workshop data saved in the same database with proper isolation
📤 CSV Upload Improvements
- Dual Upload Options: Choose between importing directly into Discovery or logging to MLflow as traces
- MLflow Config Persistence: Databricks host, token, and experiment ID remembered in localStorage
- Quote Cleanup: Automatic removal of double quotes from imported CSV and MLflow trace content
- Separate Paths: CSV-to-MLflow and CSV-to-Discovery are now independent operations
⚖️ Judge Tuning Enhancements
- Per-Question Persistence: Judge evaluation results saved per rubric question
- Automatic Restore: Switch between judges without losing evaluation data (24-hour retention)
- Explicit Judge Type: Frontend passes judge_type to backend for accurate MLflow evaluation
🔄 Phase Reset Features
- Reset Annotation: New button for facilitators to reconfigure annotation phase
- Compact Toggles: Randomization toggles streamlined to single-line format
- Reset Discovery: Improved with comprehensive data clearing
🔧 Bug Fixes & Improvements
- SQLite Concurrency: WAL mode enabled on every connection for reliable multi-user access
- Last Trace Save Fix: Complete button now properly saves final trace/annotation
- Enhanced Retry Logic: Automatic 3-retry mechanism for database saves
- Progress Tracking: Fixed issue where last trace wasn't marked as completed