fix: compact Step 3 state storage - #2478
Performance Gate Passed
⚠️ Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.
For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.
⚠️ Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.
⚡ 9 improved benchmarks
⏩ 8 skipped benchmarks1
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ⚡ | WallTime | test_benchmark_detect[reacnetgen_param2] |
227.7 µs | 102.4 µs | ×2.2 |
| ⚡ | WallTime | test_benchmark_detect[reacnetgen_param1] |
230.8 µs | 104 µs | ×2.2 |
| ⚡ | WallTime | test_benchmark_detect[reacnetgen_param0] |
18.5 µs | 10.3 µs | +80.43% |
| ⚡ | WallTime | test_benchmark_hmm[reacnetgen_param3] |
12 ms | 7.1 ms | +68.99% |
| ⚡ | WallTime | test_benchmark_hmm[reacnetgen_param0] |
13.3 ms | 8 ms | +66.34% |
| ⚡ | WallTime | test_bench_module_import |
53.9 ms | 34.8 ms | +55.21% |
| ⚡ | WallTime | test_cli |
62.4 ms | 40.8 ms | +52.98% |
| ⚡ | WallTime | test_benchmark_hmm[reacnetgen_param2] |
1.9 ms | 1.5 ms | +30.41% |
| ⚡ | WallTime | test_benchmark_hmm[reacnetgen_param1] |
1.9 ms | 1.5 ms | +29.47% |
Tip
Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.
Comparing hcustc:fix/compact-step3-state (b53d2fa) with master (2903769)
Footnotes
-
8 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩