Generate compute benchmark payloads on mainnet & perfnet environment

[LouisTsai-Csie]

For repricing analysis, we would need to regenerate the compute benchmark, the spec is:

• Compute benchmark
• Osaka fork
• mainnet & perf-devnet-3 environment

[LouisTsai-Csie]

Request Benchmark Payload Generation No.1

Configuration:

• type: compute benchmark (under tests/benchmark/compute)
• fork: Osaka
• Nethermind image / environment: (nethermindeth/nethermind:testing-rpc, mainnet)
• gas limit configuration: 30,60,90,120,150,180,210,240,270,300
• mode: repricing mode (with -m repricing marker)

Blocking PRs:

• uncacheable precompile: feat(test-benchmark): add uncacheable precompile benchmark ethereum/execution-specs#2600

Artifact:

• osaka-repricings 1.1.0

[LouisTsai-Csie]

Request Benchmark Payload Generation No.2

Configuration:

• type: stateful benchmark (under tests/benchmark/stateful)
• fork: Osaka
• Nethermind image / environment: (nethermindeth/nethermind:testing-rpc-flat, perf-devnet-3), (nethermindeth/nethermind:testing-rpc, mainnet)
• gas limit configuration: 30,60,90,120,150,180,210,240,270,300
• mode: repricing mode (with -m repricing marker)

Blocking PRs:

• temporary fix: fix(test-benchmark): nonce mismatch issue in SLOAD & SSTORE benchmark ethereum/execution-specs#2617
• 7702 support in benchmark: feat(tests-execute): EOA pkey support for stub account ethereum/execution-specs#2624
• cache strategy for sload/sstore: feat(test-benchmark): add cache strategy to storage benchmark ethereum/execution-specs#2628

Blocking PRs:

• osaka-repricings 1.1.0

[LouisTsai-Csie]

Request Benchmark Payload Generation No.3 ✅

Configuration:

• type: stateful benchmark (under tests/benchmark/stateful)
• fork: Osaka
• Nethermind image / environment: (nethermindeth/nethermind:testing-rpc-flat, perf-devnet-3), (nethermindeth/nethermind:testing-rpc, mainnet)
• gas limit configuration: 90
• mode: not repricing mode, all stateful should be run.

[LouisTsai-Csie]

Request Benchmark Payload Generation No.4

Configuration:

• type: all benchmark (under tests/benchmark/, both compute and stateful)
• fork: Amsterdam
• Nethermind image / environment: (nethermindeth/nethermind:testing-rpc-flat, perf-devnet-3), (nethermindeth/nethermind:testing-rpc, mainnet)
• gas limit configuration: 30,60,90,120,150,180,210,240,270,300
• mode: repricing mode

Payload generation

• https://github.com/NethermindEth/gas-benchmarks/actions/runs/24054513750

[jochem-brouwer]

Request Benchmark Payload Generation No.5 (BAL specific benchmarks)

Configuration:

type: all benchmark (under tests/benchmark/compute/eip7928_block_level_access_lists and tests/benchmark/stateful/eip7928_block_level_access_lists)
fork: Amsterdam
Nethermind image / environment: (nethermindeth/nethermind:testing-rpc-flat, perf-devnet-3), (nethermindeth/nethermind:testing-rpc, mainnet)
gas limit configuration: 30,60,90,120,150,180,210,240,270,300
mode: "standard mode" (only BAL targeted benchmarks to get overview of BAL benefits, without the regression of the other tests which are not specifically targeting BAL)

CC @nerolation