Skip to content

Group runs by commit SHA, update chip labels with commit time and pass fail overview#1609

Merged
prathmeshpatel merged 1 commit intomainfrom
evals-ux-improves-4
Mar 16, 2026
Merged

Group runs by commit SHA, update chip labels with commit time and pass fail overview#1609
prathmeshpatel merged 1 commit intomainfrom
evals-ux-improves-4

Conversation

@prathmeshpatel
Copy link
Collaborator

@prathmeshpatel prathmeshpatel commented Mar 14, 2026

TL;DR

Enhanced the evaluation timeline to group runs by commit SHA and added filtering capabilities to view specific run buckets.

What changed?

  • Timeline grouping logic: Runs are now grouped by commit SHA when available, with manual runs (no commit SHA) grouped by 60-second time proximity
  • Bucket data structure: Added commitSha, branch, suiteIds, passedCount, and failedCount fields to run buckets
  • Timeline UI improvements:
    • Added "All" button to clear filters and view all suites
    • Timeline chips now show commit SHA (first 7 chars) or "manual" for non-CI runs
    • Added pass/fail counts and tooltips with branch info and timestamps
    • Clicking active bucket now deselects it
  • Suite filtering: Both the suite table and failure feed now filter by selected timeline bucket
  • Active filter indicator: Shows selected commit/bucket as a removable tag above the suite table

@chelojimenez
Copy link
Contributor

chelojimenez commented Mar 14, 2026

Snyk checks have passed. No issues have been found so far.

Status Scan Engine Critical High Medium Low Total (0)
Open Source Security 0 0 0 0 0 issues
Code Security 0 0 0 0 0 issues

💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse.

@prathmeshpatel prathmeshpatel force-pushed the evals-ux-improves-4 branch 2 times, most recently from 1ed3468 to 9995255 Compare March 14, 2026 22:24
@prathmeshpatel prathmeshpatel marked this pull request as ready for review March 16, 2026 08:47
@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Mar 16, 2026
@prathmeshpatel prathmeshpatel force-pushed the evals-ux-improves-4 branch 2 times, most recently from 925f269 to f2b837a Compare March 16, 2026 09:09
@graphite-app graphite-app bot changed the base branch from evals-ux-improves-3 to graphite-base/1609 March 16, 2026 09:10
@prathmeshpatel prathmeshpatel changed the base branch from graphite-base/1609 to main March 16, 2026 09:11
@prathmeshpatel prathmeshpatel merged commit 240eb9a into main Mar 16, 2026
1 of 3 checks passed
@prathmeshpatel prathmeshpatel deleted the evals-ux-improves-4 branch March 16, 2026 09:11
@coderabbitai
Copy link
Contributor

coderabbitai bot commented Mar 16, 2026

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 58468b55-d746-4b89-9912-9312293cb725

📥 Commits

Reviewing files that changed from the base of the PR and between 1984a1f and a825d9b.

📒 Files selected for processing (1)
  • mcpjam-inspector/client/src/components/evals/overview-panel.tsx

Walkthrough

This change modifies the run-timeline bucketing logic in the overview panel. Runs are now grouped by commit SHA when available; runs without a commit SHA are grouped by 60-second proximity. The RunBucket interface has been updated to include commitSha, branch, suiteIds, passedCount, and failedCount, replacing the previous label and date fields. The UI now displays bucket metadata via tooltips and chip labels showing commit SHA prefixes or "manual" designations with pass/fail counts. An "All" filter option has been added to clear bucket filtering. The suite table and failure feed can now be filtered by the active timeline bucket selection.

📝 Coding Plan
  • Generate coding plan for human review comments

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants