[Soundness] Daily Soundness Validation - January 28, 2026

[github-actions[bot]]

🎉 Status: Zero Open Issues with "Soundness" Label

This is excellent news! The Z3 repository currently has 0 open issues labeled with "soundness", indicating that the solver's correctness is in a strong state.

Currently Monitored Issues

While no issues carry the "soundness" label, three open issues with potential soundness implications are being tracked:

🔴 Critical Issues

Issue #8397 - Soundness issue in Real (seemingly unrelated to Float)

• Status: Open (created 2 days ago)
• Assigned: @levnach
• Problem: Z3 reports sat, CVC5 reports unsat (solver disagreement)
• Test Case: Complex Real arithmetic with quantified formulas
• Reproduction: Blocked by build environment

Issue #8345 - Soundness issue by converting from bit representation to fp to Real

• Status: Open (created 3 days ago)
• Labels: Floats
• Problem: Can prove false using incremental solving
• Test Case: Float-to-Real conversion with quantifiers
• Related: Similar to Unsat only with unnecessary asserts, else unknown #8052 (incompleteness issue)
• Reproduction: Blocked by build environment

Issue #8292 - ASSERTION VIOLATION File: ../src/util/mpzzp.h Line: 139

• Status: Open (created 6 days ago)
• Assigned: @NikolajBjorner, @levnach, @Copilot
• Problem: Crash in debug build
• Test Case: Quantified Real arithmetic with to_int/to_real conversions
• Reproduction: Blocked by build environment

Workflow Status: Build Environment Issue

⚠️ Persistent Limitation

This automated validation workflow cannot compile Z3 due to missing build tools in the GitHub Actions runner environment. This has been a blocker across all 22 workflow runs since inception.

Missing: ar, gcc, g++, cmake, make

Impact:

• ✅ Can extract test cases from issues
• ✅ Can monitor for new soundness reports
• ❌ Cannot build Z3 to validate bugs
• ❌ Cannot run extracted test cases
• ❌ Cannot confirm reproduction

Required Fix

The workflow YAML needs this addition:

- name: Install build tools
  run: |
    sudo apt-get update
    sudo apt-get install -y build-essential cmake

What This Workflow Provides Today

Despite the build limitation, the workflow continues to provide value:

1. ✅ Daily Monitoring: Scans for new soundness issues
2. ✅ Test Case Extraction: Saves SMT-LIB2 files from issue reports
3. ✅ Issue Tracking: Maintains history in persistent cache
4. ✅ Status Reports: Documents open issues for maintainers
5. ✅ Pattern Analysis: Identifies trends (e.g., 75% involve floating-point)

Recommendations

For Workflow Maintainers

• Critical: Add build tools to enable actual bug reproduction
• Consider triggering on issue creation/labels, not just schedule
• Enable artifact caching for compiled binaries

For Z3 Maintainers

• Test cases are available in workflow artifacts or cache memory
• Consider whether issues Soundness issue in Real (seemingly unrelated to Float) #8397, Soundness issue by converting from bit representation to fp to Real #8345 should have "soundness" label
• Issue ASSERTION VIOLATION File: ../src/util/mpzzp.h Line: 139 #8292 is assigned to @NikolajBjorner - may be in progress

Statistics

• Issues Monitored: 5 (all time)
• Currently Open: 3
• Test Cases Extracted: 5
• Reproductions: 0 (blocked by environment)
• Workflow Runs: 22

Next Scheduled Run

Daily at 11:47 UTC

Expected Outcome: Continued monitoring; validation remains blocked without build environment fix.

---

This is an automated report from the Soundness Bug Detector workflow. Test cases and detailed tracking data are preserved in workflow cache memory.

AI generated by Soundness Bug Detector

• expires on Feb 4, 2026, 11:57 AM UTC

[github-actions[bot]]

This discussion was automatically closed because it expired on 2026-02-04T11:57:11.792Z.