Skip to content

Commit 5d1bded

Browse files
m2kulkarniclaude
andcommitted
Fig 5: memory-ablation control — cross-trial memory causally drives adaptation
Fixed per-agent trial-boundary reset (array 13142075): adaptable-map ΔR collapses from +0.93/+1.32 (memory intact) to +0.08/-0.08 (reset) at 0.10/k4 and 0.20/k4. Reset curves flat = iid trials; trial-0 unchanged. Mechanism triangulated: memory ablation (this) + deterministic-partner anchor (+0.43 survives) + demo prompting (~0 gain) => adaptation is cross-trial transformer memory of the agent's own failures. Also commits all eval result CSVs + figures (36M) so the vast.ai primary agent inherits the complete experimental record via git — only map binaries and model checkpoints still need rsync. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Ahb22g1eqZxjKWLLgsV5su
1 parent b54dff7 commit 5d1bded

866 files changed

Lines changed: 521754 additions & 0 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

notes/paper_analysis.md

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -122,6 +122,16 @@ AdA: no-op filter and PLR both strongly beat uniform; PLR wins at high trial cou
122122

123123
## Result log (newest first)
124124

125+
- 2026-07-09: **MEMORY-ABLATION CONTROL LANDED — MECHANISM PROVEN CAUSALLY**
126+
(array 13142075, fixed per-agent trial-boundary reset; fig
127+
`outputs/eval540_cachereset2/g_memory_ablation.jpg` = Fig 5).
128+
Adaptable maps: 0.10/k4 intact ΔR +0.93 vs reset **+0.08**; 0.20/k4 intact
129+
+1.32 vs reset **−0.08**. Reset curves flat (trials iid), trial-0 levels match
130+
intact within noise (correct sanity). Reviewer risk #3 CLOSED. Combined with
131+
e0001 anchor + demo results: adaptation = cross-trial transformer memory of
132+
the agent's own failures — causal, triangulated from three directions.
133+
Implementation: models.py per-agent transformer_position + evaluator.py
134+
trial-mode reset (unit tests in scripts/adaptive/verify_per_agent_reset.py).
125135
- 2026-07-08: **CURRICULUM RESULT = NULL-NEGATIVE** (eval 12952198, figs
126136
g_curriculum_doseresponse.jpg). ΔR adaptable maps (n=106, 0.10-selector):
127137
parent +0.93±0.23 > uniform+1B +0.73±0.51 > interaction+1B +0.63±0.41 >
114 KB
Loading

outputs/eval540_cachereset/per_map_R_k4_seed42_ftxa55g3.csv

Lines changed: 540 additions & 0 deletions
Large diffs are not rendered by default.

outputs/eval540_cachereset/per_map_R_k4_seed42_qxw6c0jh.csv

Lines changed: 540 additions & 0 deletions
Large diffs are not rendered by default.

outputs/eval540_cachereset/per_map_R_k4_seed43_citbzhdc.csv

Lines changed: 540 additions & 0 deletions
Large diffs are not rendered by default.

outputs/eval540_cachereset/per_map_R_k4_seed43_ufmegw4l.csv

Lines changed: 540 additions & 0 deletions
Large diffs are not rendered by default.

outputs/eval540_cachereset/per_map_R_k4_seed44_c0k9uqhc.csv

Lines changed: 540 additions & 0 deletions
Large diffs are not rendered by default.

outputs/eval540_cachereset/per_map_R_k4_seed44_jsckmpha.csv

Lines changed: 540 additions & 0 deletions
Large diffs are not rendered by default.

outputs/eval540_cachereset/per_map_collision_k4_seed42_ftxa55g3.csv

Lines changed: 540 additions & 0 deletions
Large diffs are not rendered by default.

outputs/eval540_cachereset/per_map_collision_k4_seed42_qxw6c0jh.csv

Lines changed: 540 additions & 0 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)