Auto-switch to suite view for manual runs + add progress bars and pagination to failures

[prathmeshpatel]

TL;DR

Added auto-switching to "By Suite" view when all evaluation runs are manual, enhanced the failures section with progress bars and pagination.

What changed?

• Auto-switching behavior: The CI Evals tab now automatically switches to "By Suite" sidebar mode when all evaluation runs have manual commit SHAs (no automated CI runs)
• Visual progress indicators: Failed test suites now display a colored progress bar showing pass rate, with amber for ≥75% and red for lower rates
• Pagination for failures: Added "Show more" functionality to the failures section, initially showing 10 entries with the ability to load 20 more at a time
• Improved failure display: Restructured the failure entry layout to show pass/fail ratios with progress bars and better visual hierarchy

[chelojimenez]

✅ Snyk checks have passed. No issues have been found so far.

Status	Scan Engine	Critical	High	Medium	Low	Total (0)
✅	Open Source Security	0	0	0	0	0 issues
✅	Code Security	0	0	0	0	0 issues

💻 Catch issues earlier using the plugins for VS Code, JetBrains IDEs, Visual Studio, and Eclipse.

[prathmeshpatel]

• Remove CI evals overview panel and tag filtering #1623
• Auto-switch to suite view for manual runs + add progress bars and pagination to failures #1614 👈 (View in Graphite)
• Simplify evals dash cont. #1613
• Clean up sidebar and other top improves #1612
• Hide AI triage panel when unavailable and prevent auto-requests #1611
• Remove AI triage frontend call logic and cleanup AI look #1610
• Group runs by commit SHA, update chip labels with commit time and pass fail overview #1609
• Frontend AI triage insights #1608
• Improve commit detail view #1607
• Evals CI/CD UX overview improves pt. 1 #1602
• [SDK] Add group filtering #1595
• main

This stack of pull requests is managed by Graphite. Learn more about stacking.

[coderabbitai]

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 2b946635-fc16-4abe-85a7-488059a1e4bc

📥 Commits

Reviewing files that changed from the base of the PR and between a7889b2 and 034f70e.

📒 Files selected for processing (5)

• mcpjam-inspector/.env.local
• mcpjam-inspector/client/src/components/CiEvalsTab.tsx
• mcpjam-inspector/client/src/components/evals/ci-suite-list-sidebar.tsx
• mcpjam-inspector/client/src/components/evals/overview-panel.tsx
• mcpjam-inspector/client/src/components/evals/use-ai-triage.ts

---

Walkthrough

This change updates Convex deployment endpoints and refactors the CI evaluation UI. The sidebar auto-switches to "By Suite" view when all commits use manual SHAs. Suite name grouping and display now normalize by stripping trailing timestamp suffixes for consistency. The failure feed gains pagination with "Show more" controls and displays pass rates via progress bars instead of inline text. The AI triage system is overhauled to use reference-based request tracking rather than mutation existence checks, reset state on run-key changes while preserving unavailable status, and gracefully handle backend unavailability.

📝 Coding Plan

• Generate coding plan for human review comments

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}