Skip to content

feat(memory): benchmarking harness, cost-sensitive store routing, goal-conditioned write gate#2485

Merged
bug-ops merged 2 commits intomainfrom
memory-benchmarking-harness
Mar 30, 2026
Merged

feat(memory): benchmarking harness, cost-sensitive store routing, goal-conditioned write gate#2485
bug-ops merged 2 commits intomainfrom
memory-benchmarking-harness

Conversation

@bug-ops
Copy link
Copy Markdown
Owner

@bug-ops bug-ops commented Mar 30, 2026

Summary

Closes #2419, #2444, #2408.

Test plan

@github-actions github-actions bot added enhancement New feature or request size/XL Extra large PR (500+ lines) documentation Improvements or additions to documentation memory zeph-memory crate (SQLite) rust Rust code changes core zeph-core crate and removed size/XL Extra large PR (500+ lines) labels Mar 30, 2026
@bug-ops bug-ops force-pushed the memory-benchmarking-harness branch from d5a23c4 to 791a320 Compare March 30, 2026 22:18
@github-actions github-actions bot added the size/XL Extra large PR (500+ lines) label Mar 30, 2026
@bug-ops bug-ops enabled auto-merge (squash) March 30, 2026 22:20
@bug-ops bug-ops force-pushed the memory-benchmarking-harness branch from c7f7e15 to 05c8820 Compare March 30, 2026 22:25
bug-ops added 2 commits March 31, 2026 00:32
…l-conditioned write gate

Closes #2419, #2444, #2408.

- #2419: Add .local/testing/bench-memory.py — seeds N facts, runs M recall
  queries, reports hit_rate/latency/compression/interference as JSON with
  CSV append for longitudinal tracking.

- #2444: Add cost-sensitive store routing to zeph-memory. New StoreRouter
  trait with HeuristicRouter, LlmRouter, and HybridRouter. HybridRouter
  uses heuristic confidence signal and escalates to LLM only when
  ambiguous. New [memory.store_routing] config section with
  routing_classifier_provider field. Follow-up wiring: #2484.

- #2408: Add CraniMem goal-conditioned write gate to admission control.
  goal_utility added as 6th AdmissionFactor. Gate is disabled by default
  (goal_conditioned_write = false). Degenerate goal text guard (<10 chars)
  prevents arbitrary admission on trivial inputs. New goal_utility_provider
  config field. Follow-up wiring: #2483.
@bug-ops bug-ops force-pushed the memory-benchmarking-harness branch from 05c8820 to e0fcecb Compare March 30, 2026 22:32
@bug-ops bug-ops merged commit b447fa1 into main Mar 30, 2026
27 checks passed
@bug-ops bug-ops deleted the memory-benchmarking-harness branch March 30, 2026 22:39
bug-ops added a commit that referenced this pull request Mar 30, 2026
Adds .local/testing/bench-memory.py: stdlib-only Python benchmarking
harness that seeds N facts into SQLite (FTS5), runs M recall queries,
and reports hit_rate, avg_recall_latency_ms, p50_ms, p99_ms,
compression_ratio, and interference_rate as JSON with CSV append for
longitudinal tracking.

Closes #2492
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

core zeph-core crate documentation Improvements or additions to documentation enhancement New feature or request memory zeph-memory crate (SQLite) rust Rust code changes size/XL Extra large PR (500+ lines)

Projects

None yet

1 participant