Improve commit detail view

[prathmeshpatel]

TL;DR

Added a new commit-based view to the CI evals interface that groups test runs by Git commit SHA, providing better visibility into test results across different code changes.

• Added a new "Runs by commit" sidebar mode alongside the existing "Suites" view
• Created CommitDetailView component that displays comprehensive test results for a specific commit including:
  • Overall pass rate with visual progress bar
  • AI-powered triage summary for failures
  • Categorized sections for failed, passed, running, and not-run tests
  • Environment configuration details
  • Comparison functionality between commits
• Implemented groupRunsByCommit helper function to organize test runs by commit SHA
• Added new routing support for /ci-evals/commit/{sha} URLs
• Created CommitListSidebar component for navigating between commits
• Added comprehensive test coverage for the new grouping logic
• Quickly identify which commits introduced test failures
• Compare test results between different code versions
• Get AI-powered insights into failure patterns
• Better understand the relationship between code changes and test outcomes

[chelojimenez]

✅ Snyk checks have passed. No issues have been found so far.

Status	Scan Engine	Critical	High	Medium	Low	Total (0)
✅	Open Source Security	0	0	0	0	0 issues
✅	Code Security	0	0	0	0	0 issues

💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse.

[prathmeshpatel]

• Remove CI evals overview panel and tag filtering #1623
• Auto-switch to suite view for manual runs + add progress bars and pagination to failures #1614
• Simplify evals dash cont. #1613
• Clean up sidebar and other top improves #1612
• Hide AI triage panel when unavailable and prevent auto-requests #1611
• Remove AI triage frontend call logic and cleanup AI look #1610
• Group runs by commit SHA, update chip labels with commit time and pass fail overview #1609
• Frontend AI triage insights #1608
• Improve commit detail view #1607 👈 (View in Graphite)
• Evals CI/CD UX overview improves pt. 1 #1602
• [SDK] Add group filtering #1595
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[graphite-app]

Merge activity

• Mar 16, 9:04 AM UTC: This pull request can not be added to the Graphite merge queue. Please try rebasing and resubmitting to merge when ready.
• Mar 16, 9:04 AM UTC: Graphite disabled "merge when ready" on this PR due to: a merge conflict with the target branch; resolve the conflict and try again..

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: bff9d9ff-3435-4511-9bbb-1fe11dc9c675

📥 Commits

Reviewing files that changed from the base of the PR and between 778405b and 837c993.

📒 Files selected for processing (10)

• mcpjam-inspector/client/src/components/CiEvalsTab.tsx
• mcpjam-inspector/client/src/components/evals/__tests__/commit-detail-view.test.ts
• mcpjam-inspector/client/src/components/evals/__tests__/group-runs-by-commit.test.ts
• mcpjam-inspector/client/src/components/evals/ci-suite-list-sidebar.tsx
• mcpjam-inspector/client/src/components/evals/commit-detail-view.tsx
• mcpjam-inspector/client/src/components/evals/commit-list-sidebar.tsx
• mcpjam-inspector/client/src/components/evals/helpers.ts
• mcpjam-inspector/client/src/components/evals/types.ts
• mcpjam-inspector/client/src/lib/__tests__/ci-evals-router.test.ts
• mcpjam-inspector/client/src/lib/ci-evals-router.ts

---

Walkthrough

This pull request introduces a commit-detail view feature for the CI Evals inspector. It adds a new CommitGroup type to aggregate evaluation runs by commit SHA, alongside a CommitDetailView component that displays run categorization, duration metrics, environment context, and a failure triage summary. A new CommitListSidebar enables browsing commits with status indicators and metadata. The sidebar in CiEvalsTab now toggles between "suites" and "runs" modes via SidebarMode. Helper functions groupRunsByCommit() and formatRelativeTime() support the data transformation and presentation. Routing has been extended with a commit-detail route pattern. Comprehensive test coverage validates the grouping logic, component behavior, and routing integration.

📝 Coding Plan

• Generate coding plan for human review comments

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}