Skip to content

[Feature] Sidecar: emit CrossHair summary counts #55

@djm81

Description

@djm81

Feature Description

Emit a concise CrossHair summary in sidecar runs and write a small summary file (e.g., JSON or markdown) alongside the logs.

Use Case

Primary Use Case: Brownfield Modernization

When running sidecar validation, we need quick visibility into how many contracts were confirmed vs not confirmed, plus whether any counterexamples/violations occurred.

Motivation

Currently the CrossHair output is only in the raw log. A summary makes results easier to track across repos and reduces manual log scanning.

Proposed Solution

  • Parse CrossHair output to count:
    • Confirmed over all paths
    • Not confirmed
    • Counterexamples/violations
  • Print a summary line at the end of run_sidecar.sh
  • Write a summary file (e.g., crosshair-summary.json) into the sidecar reports folder

Alternative Solutions

Continue to parse logs manually or via ad-hoc scripts.

Additional Context

We are using sidecar Phase B validation on Requests, Flask, and SpecFact CLI dogfooding. Summary counts are currently tracked manually in the validation tracker.

Impact

  • User Impact: Medium
  • Complexity: Small
  • Brownfield Relevance: Medium

Related Issues/PRs

  • N/A

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions