Refactor of the Scheduler package to enable or setup for: distributed benchmarks, multi-turn requests, advanced stopping criteria, large concurrency, multi modality, evaluations#251

Closed

markurtz wants to merge 56 commits intomainfrom

features/scheduler_refactor

Commits on Jul 31, 2025

Initial state for new refactor of scheduler
markurtz
committed
Implement SchedulingStrategy and derivative classes so they work with the Scheduler refactor
markurtz
committed
Finalize adapting scheduler strategies to new refactor logic, additionally expand logic to support startup_duration params
markurtz
committed

Commits on Aug 1, 2025

Commits on Aug 4, 2025

Refactors to simplify and enable benchmark profiles
markurtz
committed

Commits on Aug 5, 2025

Finalize refactor of profile, refactor benchmarker
markurtz
committed

Commits on Aug 6, 2025

Refactor benchmark object, benchmarker, and introduce aggregators as reducer patterns for working with the new scheduler refactor
markurtz
committed

Commits on Aug 7, 2025

Refactor entyrpoints and benchmark pathways for new scheduler and benchmarker
markurtz
committed

Commits on Aug 9, 2025

Refactor and updates for progress and outputs to work with the new structure
markurtz
committed

Commits on Aug 11, 2025

Latest state with the bulk of tests for the scheduler and bug fixes
markurtz
committed

Commits on Aug 12, 2025

Tests and fixes for WorkerProcess and supporting changes
markurtz
committed

Commits on Aug 14, 2025

Implement tests and fixes for scheduler to finish of scheduler package for now
markurtz
committed

Commits on Aug 19, 2025

Commits on Aug 20, 2025

Commits on Aug 25, 2025

Commits on Aug 26, 2025

Commits on Aug 29, 2025

Commits on Aug 30, 2025

Updates to remove the measured request timings generic and replace it with pydantic polymorphism
markurtz
committed

Commits on Sep 2, 2025

Commits on Sep 3, 2025

Commits on Sep 4, 2025

latest updates and working state
markurtz
committed

Commits on Sep 9, 2025

Minor updates for pydantic objects
markurtz
committed

Commits on Sep 15, 2025

Apply field constraint to each item in type
sjmonson
committed