Skip to content

v1.5.0: Coding Specs, Multi-Workshop Support, CSV Upload into mlflow, multiple Judge Tuning.

Choose a tag to compare

@vivian-xie-db vivian-xie-db released this 17 Jan 14:53
· 94 commits to main since this release
v1.5.0
a01c4f5

🎉 Release v1.5.0

📦 Installation

Download project-with-build.zip which includes pre-built frontend assets.

Coding agent support

  • Structured specs definition: better support for Claude/AI coding assistants to understand patterns
  • Enables AI coding agents: quickly find relevant documentation when working on specific features.

Toggle Randomization:

  • Facilitator can choose to turn on randomization of traces in discovery and annotation phase to enable participants/SMEs to see the same set of traces but in different order
  • Default setting is OFF.

🏢 Multi-Workshop Support

  • Isolated Workshop Data: One facilitator can create separate workshops with isolated data
  • Workshop Selection: Participants/SMEs can select which workshop to join from login page
  • Persistent Storage: All workshop data saved in the same database with proper isolation

📤 CSV Upload Improvements

  • Dual Upload Options: Choose between importing directly into Discovery or logging to MLflow as traces
  • MLflow Config Persistence: Databricks host, token, and experiment ID remembered in localStorage
  • Quote Cleanup: Automatic removal of double quotes from imported CSV and MLflow trace content
  • Separate Paths: CSV-to-MLflow and CSV-to-Discovery are now independent operations

⚖️ Judge Tuning Enhancements

  • Per-Question Persistence: Judge evaluation results saved per rubric question
  • Automatic Restore: Switch between judges without losing evaluation data (24-hour retention)
  • Explicit Judge Type: Frontend passes judge_type to backend for accurate MLflow evaluation

🔄 Phase Reset Features

  • Reset Annotation: New button for facilitators to reconfigure annotation phase
  • Compact Toggles: Randomization toggles streamlined to single-line format
  • Reset Discovery: Improved with comprehensive data clearing

🔧 Bug Fixes & Improvements

  • SQLite Concurrency: WAL mode enabled on every connection for reliable multi-user access
  • Last Trace Save Fix: Complete button now properly saves final trace/annotation
  • Enhanced Retry Logic: Automatic 3-retry mechanism for database saves
  • Progress Tracking: Fixed issue where last trace wasn't marked as completed