Skip to content
This repository was archived by the owner on Jul 10, 2026. It is now read-only.

test: benchmark comparison with expensive increment function - #108

Closed
0xShaito wants to merge 8 commits into
devfrom
test/benchmark
Closed

test: benchmark comparison with expensive increment function#108
0xShaito wants to merge 8 commits into
devfrom
test/benchmark

Conversation

@0xShaito

Copy link
Copy Markdown
Member

Summary

Testing the benchmark artifact archive feature with a significantly more expensive increment function.

Changes

  • Added a 1000-iteration loop to the increment() function
  • Each iteration performs multiplication and conditional division
  • This will dramatically increase gate count for benchmark comparison testing

Purpose

Validate that the benchmark comparison system correctly detects and reports significant performance regressions between branches.

@github-actions

Copy link
Copy Markdown

Benchmark Comparison

CPU Cores RAM Arch
N/A N/A N/A N/A

Contract: counter

Function Gates DA Gas L2 Gas Proving Time (ms)
Status Base PR Diff Base PR Diff Base PR Diff Base PR Diff
increment 472,292 472,292 2,253 2,253 28,872 28,872 N/A N/A

Co-authored-by: Claude <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown

Benchmark Comparison

CPU Cores RAM Arch
N/A N/A N/A N/A

Contract: counter

Function Gates DA Gas L2 Gas Proving Time (ms)
Status Base PR Diff Base PR Diff Base PR Diff Base PR Diff
🆕 increment 0 472,292 +Inf% 0 2,253 +Inf% 0 28,872 +Inf% N/A N/A

- Revert suffix naming to _latest/_new to match dev baseline uploads
- Add assert(sum > 0) to prevent compiler from optimizing away the test loop

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Feb 1, 2026

Copy link
Copy Markdown

Benchmark Comparison

CPU Cores RAM Arch
N/A N/A N/A N/A

Contract: counter

Function Gates DA Gas L2 Gas Proving Time (ms)
Status Base PR Diff Base PR Diff Base PR Diff Base PR Diff
increment 472,292 472,292 2,253 2,253 28,872 28,872 N/A N/A

The Noir compiler was optimizing away the deterministic loop at compile time.
By seeding the computation with msg_sender(), the compiler cannot evaluate
the loop statically and must include it in the circuit.

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Feb 1, 2026

Copy link
Copy Markdown

Benchmark Comparison

CPU Cores RAM Arch
N/A N/A N/A N/A

Contract: counter

Function Gates DA Gas L2 Gas Proving Time (ms)
Status Base PR Diff Base PR Diff Base PR Diff Base PR Diff
🔴 increment 472,292 494,153 +21,861 (+4.6%) 2,253 2,253 28,872 28,872 N/A N/A

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Feb 1, 2026

Copy link
Copy Markdown

Benchmark Comparison

CPU Cores RAM Arch
N/A N/A N/A N/A

Contract: counter

Function Gates DA Gas L2 Gas Proving Time (ms)
Status Base PR Diff Base PR Diff Base PR Diff Base PR Diff
🔴 increment 472,292 575,153 +102,861 (+21.8%) 2,253 2,253 28,872 28,872 N/A N/A

- Use aztec-benchmark action to run AND compare in one step (remove only_report)
- Standardize on _base suffix (action's default) instead of custom naming
- Add transition step to rename _latest files from dev to _base
- Remove redundant manual benchmark run step

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Feb 1, 2026

Copy link
Copy Markdown

Benchmark Comparison

CPU Cores RAM Arch
N/A N/A N/A N/A

Contract: counter

Function Gates DA Gas L2 Gas Proving Time (ms)
Status Base PR Diff Base PR Diff Base PR Diff Base PR Diff
🔴 increment 472,292 575,153 +102,861 (+21.8%) 2,253 2,253 28,872 28,872 N/A N/A

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Feb 1, 2026

Copy link
Copy Markdown

Benchmark Comparison

CPU Cores RAM Arch
N/A N/A N/A N/A

Contract: counter

Function Gates DA Gas L2 Gas Proving Time (ms)
Status Base PR Diff Base PR Diff Base PR Diff Base PR Diff
increment 472,292 472,292 2,253 2,253 28,872 28,872 N/A N/A

Adds a 5000-iteration loop to the increment function to generate a
significant gate count difference for benchmark comparison testing.
Reverts workflow changes to use existing naming convention.
@github-actions

github-actions Bot commented Feb 2, 2026

Copy link
Copy Markdown

Benchmark Comparison

CPU Cores RAM Arch
N/A N/A N/A N/A

Contract: counter

Function Gates DA Gas L2 Gas Proving Time (ms)
Status Base PR Diff Base PR Diff Base PR Diff Base PR Diff
🔴 increment 472,292 575,153 +102,861 (+21.8%) 2,253 2,253 28,872 28,872 N/A N/A

@0xShaito 0xShaito closed this Feb 2, 2026
@wei3erHase
wei3erHase deleted the test/benchmark branch February 2, 2026 19:31
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant