-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Feature Description
Emit a concise CrossHair summary in sidecar runs and write a small summary file (e.g., JSON or markdown) alongside the logs.
Use Case
Primary Use Case: Brownfield Modernization
When running sidecar validation, we need quick visibility into how many contracts were confirmed vs not confirmed, plus whether any counterexamples/violations occurred.
Motivation
Currently the CrossHair output is only in the raw log. A summary makes results easier to track across repos and reduces manual log scanning.
Proposed Solution
- Parse CrossHair output to count:
- Confirmed over all paths
- Not confirmed
- Counterexamples/violations
- Print a summary line at the end of
run_sidecar.sh - Write a summary file (e.g.,
crosshair-summary.json) into the sidecar reports folder
Alternative Solutions
Continue to parse logs manually or via ad-hoc scripts.
Additional Context
We are using sidecar Phase B validation on Requests, Flask, and SpecFact CLI dogfooding. Summary counts are currently tracked manually in the validation tracker.
Impact
- User Impact: Medium
- Complexity: Small
- Brownfield Relevance: Medium
Related Issues/PRs
- N/A
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request
Type
Projects
Status
In Progress