Skip to content

Commit fd713f2

Browse files
dzhelezovclaude
andcommitted
docs(benchmarks): consolidate the 15-chain flagship + honest variance into BENCHMARKS.md (S5)
BENCHMARKS.md presented only the single-chain full-history 3.6x result; the actual headline (15 chains, 28.4M events, 51m 47s) lived only in harness/euler-multichain/REPORT.md. Add a "Flagship — 15 chains, one app" section immediately before the F-full cell (lightly reframed as the single-chain companion) presenting both flagship runs, the deterministic zero-RPC kit metrics, and the honest +15.3% run-to-run variance paragraph (flagged-but-unattributed) so the doc is self-contained as the canonical benchmark reference. Docs-only; all numbers verbatim from REPORT.md / results/flagship-2026-07-06/ artifacts. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
1 parent 139d663 commit fd713f2

1 file changed

Lines changed: 41 additions & 1 deletion

File tree

harness/bench/BENCHMARKS.md

Lines changed: 41 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -68,7 +68,47 @@ indexing + chunk amortization), staying stable at **1.6 GB RSS / 0 errors** on 1
6868
amortize too (7.7 → 6 KB/event). `feature-blocks` is the outlier — 85 s for 2,001 ticks — the block-source
6969
`includeAllBlocks` scan (optimization #1 below).
7070

71-
## Full-history backfill — F-full flagship cell
71+
## Flagship — 15 chains, one app (28.4M events, 51m 47s)
72+
73+
The headline production run: **one** Ponder app indexing **every Portal-supported Euler V2 chain (15)**,
74+
full history from each `eVaultFactory` deploy to a fixed finalized head — **28,405,932 events across
75+
2,484 vaults** — streamed from the SQD Portal into Postgres. On 2026-07-06 it was **reproduced from
76+
scratch** by the deterministic zero-RPC bench kit and passed the whole-store parity gate against the
77+
frozen reference store. Full write-up: [`../euler-multichain/REPORT.md`](../euler-multichain/REPORT.md).
78+
79+
| metric | value |
80+
|---|---|
81+
| wall time | **3107 s (51m 47s)**; start→ready 3118.6 s |
82+
| clean / all-complete | **true / true** |
83+
| chains complete | **15 / 15** (each `completedBlocks == totalBlocks`) |
84+
| RPC requests / errors | **90 / 0** — exactly 6/chain × 15, all served by the kit's LOCAL anchor shim from a committed snapshot |
85+
| store parity vs frozen reference | **pass — 62/62 cells, 0 diffs** |
86+
| total log rows (both sides) | **28,405,932** |
87+
| store totals | blocks **4,646,445** / transactions **5,007,056** |
88+
| envelope | MemoryMax=16G, CPUQuota=200% (2 cores) on a 96-core host; node v22.22.2; `PORTAL_CHECKS=off`; Postgres 16.14 local |
89+
90+
**Zero external RPC.** The 90 RPC requests were all served from a committed anchor snapshot by the kit's
91+
local shim; the ponder process's only remote endpoint was the SQD Portal — the entire dataset came from
92+
the Portal. Artifacts are committed under [`results/flagship-2026-07-06/`](results/flagship-2026-07-06/);
93+
the whole-store 62-cell parity chain of custody is in **VALIDATION.md §5.7** (fresh Portal-only backfill
94+
vs frozen reference).
95+
96+
**Wall time vs the config-b baseline — honest delta.** 51m 47s (3107 s) is **+15.3 %** over the previously
97+
published **44m 55s (2695 s)** config-b baseline (2026-07-01), same 16 GB / 2-core envelope. The two runs
98+
are on **different dates against a live Portal service** *and* the code under test differs — the 2026-07-01
99+
baseline predates several fixes merged since, plus the PR #71 branch in this build — so the delta is
100+
**flagged but unattributed**: two data points cannot split it between Portal-throughput variance and code
101+
changes, and no claim is made either way. What is new: the deterministic kit makes future comparisons
102+
apples-to-apples (fixed anchor snapshot, zero public-RPC noise). *(For candor: an earlier ad-hoc 2026-07-06
103+
attempt clocked 65m 55s but was polluted — a public-RPC finality-probe wedge blocked `/ready` for ~17 min,
104+
`PORTAL_CHECKS=on`, co-resident load — not a valid headline, recorded only for candor.)*
105+
106+
**Config A/B lesson (2026-07-01).** On the identical 28.4M events, a modest **16 GB / 2-core** config
107+
(44m 55s, 9.2 GB peak, **10,513 ev/s**) beat an over-provisioned **32 GB** config (67m 10s, 19.0 GB,
108+
7,024 ev/s): **right-size the indexer, tune the database** — don't over-provision. Full table in
109+
[`../euler-multichain/REPORT.md`](../euler-multichain/REPORT.md).
110+
111+
## Full-history backfill — single-chain 3.6× (F-full flagship cell)
72112

73113
The paid validation cell **F-full** (VALIDATION.md §3.2) also yields the first end-to-end
74114
**full-history** backfill timing: the entire recorded Euler v2 history on eth mainnet,

0 commit comments

Comments
 (0)