Skip to content

Use radar charts for Bencher summaries#8010

Draft
achamayou wants to merge 12 commits into
mainfrom
radars
Draft

Use radar charts for Bencher summaries#8010
achamayou wants to merge 12 commits into
mainfrom
radars

Conversation

@achamayou

Copy link
Copy Markdown
Member

Summary

  • Trigger the Bencher workflow on pushes to both main and radars.
  • Replace per-benchmark XY chart tables in the Bencher performance summary with Mermaid radar charts grouped by metric type.
  • Render radar curves as line-only overlays with distinct colours, using each benchmark as an axis and normalized EWMA baselines for comparison.

Validation

  • python3 -m py_compile scripts/perf_summary.py
  • python3 scripts/perf_summary.py /tmp/ccf-bencher-main/virtual
  • python3 scripts/perf_summary.py /tmp/ccf-bencher-main/snp
  • git diff --check -- .github/workflows/bencher.yml .github/workflows/README.md scripts/perf_summary.py

Comment thread scripts/perf_summary.py Outdated
achamayou and others added 8 commits July 1, 2026 09:57
Co-authored-by: Eddy Ashton <edashton@microsoft.com>
Render the stddev range as a shaded band and tune the chart layout, labels, and colors for job summaries.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Remove the dashed EWMA curve from perf radar charts so the summary shows only the latest run against the stddev range. Minimize the custom radar CSS and use the dual-theme-safe preview colors.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Drop radar settings that match Mermaid defaults or are not used by the radar renderer, keeping the generated summary focused on the layout and styling differences it actually needs.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Make the radar interior blend with GitHub light and dark backgrounds, switch the stddev range to a light blue band, and include latest-run normalized percentages in each axis label.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Show thin blue outlines on both sides of the stddev envelope and include latest real metric values alongside normalized percentages in radar axis labels.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants