Add errors section, fix dynamic evals date issue #31
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request introduces a monthly error analysis feature to the evaluation dashboard and adds supporting backend and utility scripts for improved forecasting evaluation. The main changes include a new backend API endpoint for monthly metrics, frontend integration with visualization and error highlighting, and utility scripts to support unbiased evaluation data management.
Monthly Error Analysis Feature
/evaluation/static/monthlyto provide monthly RMSE/MAE error metrics, enabling the identification of seasonal patterns and months with highest/lowest errors.EvaluationPage. [1] [2] [3]MonthlyMetrics,MonthlyAnalysis) to type the monthly analysis data structure.Evaluation Data Management Utilities
scripts/clean_dynamic_eval.py, a utility script to safely delete dynamic evaluation data from BigQuery, with interactive and force modes, to prepare for unbiased (hourly) evaluation.scripts/populate_dynamic_evaluation.pyto default to hourly (--interval 1) predictions for unbiased evaluation, and added a warning if a larger interval is used, to prevent temporal bias in metrics. [1] [2]