Document Regret Analysis Methodology #60
Description
Summary
Document how regret is calculated and analyzed in the benchmark.
Scope
- Regret definition: Difference from optimal (oracle) performance
- Cumulative regret: Running sum of per-query regret
- Normalized regret: Per-query average regret
- Regret bounds: Theoretical bounds for each algorithm
- Regret visualization: How regret curves are plotted
Priority
Medium - Important for paper but can reference standard definitions
Acceptance Criteria
- Regret formulas (instantaneous, cumulative)
- Oracle baseline definition
- Regret curve interpretation
- Comparison to theoretical bounds