Summary
As clinical sub-domain label maps and synthetic fixtures multiply, there is no single eval that verifies every shipped domain has a matching fixture, every fixture label resolves to a catalog label, and per-label span coverage is non-empty. Without this gate, domain maps and fixtures drift apart silently.
Scope
Acceptance criteria
Out of scope
- No F1/accuracy scoring against a gold model (coverage and consistency only)
- No restricted datasets; operates on committed synthetic fixtures
- No new model training
Files
- openmed/eval/domain_coverage.py
- tests/unit/eval/test_domain_coverage.py
- .github/workflows/eval.yml
- docs/clinical-domains.md
Task: OM-508 · Milestone: v2.2 · Priority: P1 · Size: M
Depends on: OM-018, OM-176, OM-412 · Blocks: —
Roadmap: v2.2 trustworthy clinical data exchange follow-on wave
Spec: PLANS/V2/EXECUTION/tasks/OM-508.md
Summary
As clinical sub-domain label maps and synthetic fixtures multiply, there is no single eval that verifies every shipped domain has a matching fixture, every fixture label resolves to a catalog label, and per-label span coverage is non-empty. Without this gate, domain maps and fixtures drift apart silently.
Scope
Acceptance criteria
Out of scope
Files
Task: OM-508 · Milestone: v2.2 · Priority: P1 · Size: M
Depends on: OM-018, OM-176, OM-412 · Blocks: —
Roadmap: v2.2 trustworthy clinical data exchange follow-on wave
Spec: PLANS/V2/EXECUTION/tasks/OM-508.md