Skip to content

Benchmark script to wrap dtest #202

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tameware merged 25 commits into from
Jun 21, 2026
Merged

Benchmark script to wrap dtest #202

Changes from 23 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
5935062
Initial commit
tameware Jun 18, 2026
1c6a1b2
Do not hard-code the path for binary that's not in the repo
tameware Jun 18, 2026
d8c6a3b
make dtest2 optional
tameware Jun 18, 2026
1c01ef3
Added max-deals parameter
tameware Jun 18, 2026
afb842e
Add --build option to benchmark.sh for dtest.
tameware Jun 19, 2026
53119b4
Pass dtest options via -- in benchmark.sh.
tameware Jun 19, 2026
2602a99
Rename benchmark repeat flag to --repeats and improve dry-run output.
tameware Jun 19, 2026
e3077c2
Fix benchmark.sh help text and max-deals error message.
tameware Jun 19, 2026
32fba00
Rename benchmark binaries to branch/compare and fix column alignment.
tameware Jun 19, 2026
5d508c1
Align benchmark summary speedup and note columns.
tameware Jun 19, 2026
69af21e
Harden benchmark.sh validation, parsing, and compare summary.
tameware Jun 19, 2026
6555a88
Address PR review comments in benchmark.sh.
tameware Jun 19, 2026
f0b69d3
Improve benchmark run order, summary metrics, and compare sequencing.
tameware Jun 19, 2026
aa3ddc7
Derive avg_user in benchmark when dtest omits the avg line.
tameware Jun 21, 2026
5626ea7
Fix benchmark summary ratio when branch_avg is zero.
tameware Jun 21, 2026
713186d
Interleave branch and compare runs per repeat in benchmark.
tameware Jun 21, 2026
083016d
Revert "Fix benchmark summary ratio when branch_avg is zero."
tameware Jun 21, 2026
9a989bd
Simplify benchmark cmp/branch ratio when averages are positive.
tameware Jun 21, 2026
7096445
Show summary only by default when benchmarking with --compare.
tameware Jun 21, 2026
7293c3e
Show transient per-run progress during compare benchmarks.
tameware Jun 21, 2026
aa99cbd
Drop cmp/branch interpretation from benchmark summary header.
tameware Jun 21, 2026
9bb879e
Add epsilon tolerance for equal benchmark comparisons.
tameware Jun 21, 2026
9e9284b
Document --epsilon in benchmark.sh usage examples.
tameware Jun 21, 2026
429ec25
Note TestTimer ms truncation in benchmark summary comment.
tameware Jun 21, 2026
118d524
Clarify benchmark comment on zero timing from ms truncation.
tameware Jun 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading