Skip to content

Commit a7e6050

Browse files
authored
feat(site): fill postgres_ingest Cat 7 cell (0.392) + 9th drill-down row (#169)
Last cell. postgres_ingest LoCoMo-10 E2E QA 0.392 (vs flat 0.384, Δ noise) lands in both the field_roster source JSON and the explorer embedded #fieldData, sme_measured, magic-link to the now-committed locomo10_postgres_e2e_stratified baseline. Caveat footnote carries the conservative 4-filter-handicap framing. Static drill-down gains the postgres_ingest 9th row (mempalace-raw ablation, flat-twin) + 'benched eight'→'benched nine'. Explorer + drill-down now agree at 9. Closes #169.
1 parent 5f4f62e commit a7e6050

2 files changed

Lines changed: 23 additions & 9 deletions

File tree

baselines/cross_system_multipass_matrix_2026-05-30.json

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -557,10 +557,10 @@
557557
"source_type": "not_run"
558558
},
559559
"postgres_ingest": {
560-
"value": null,
561-
"metric": "LoCoMo E2E QA accuracy (n=250 stratified, identical subset to flat)",
560+
"value": 0.392,
561+
"metric": "LoCoMo-10 E2E QA accuracy (n=250 stratified, identical subset to flat; weighted 0.4337)",
562562
"scoreability": "scoreable",
563-
"note": "postgres LoCoMo-10 E2E QA in flight (reader=judge=gpt-5.3-chat, exact 250-q subset flat used). Number lands shortly; compare to flat 0.384 unweighted / 0.4255 weighted.",
563+
"note": "postgres+pgvector LoCoMo-10 E2E QA, reader=judge=gpt-5.3-chat, EXACT 250-q subset flat used. 0.392 vs flat 0.384 (Δ noise) — storage substrate ≈ flat on QA too. CONSERVATIVE: 4/250 reader calls hit Azure content_filter (LoCoMo×Azure artifact, non-deterministic) → empty answer → judged incorrect, IN n_scored; flat hit 0 filters on its 2026-05-29 run, so postgres carried a 4-q handicap and still matched flat. Lift is the graph/reader, not the backend.",
564564
"source": "https://github.com/techempower-org/multipass-structural-memory-eval/blob/main/baselines/locomo10_postgres_e2e_stratified_2026-05-31.json",
565565
"source_type": "sme_measured"
566566
}

0 commit comments

Comments
 (0)