eval: add offline trajectory value comparison #1738
benchmarks.yml
on: pull_request
Plan Benchmarks
24s
Matrix: host_validation
Benchmark Static Quality
16s
Benchmark Contracts, Adapters, Records & Digests
19s
Matrix: oracle
Publish Benchmark Timings
24s
Annotations
2 warnings
|
Plan Benchmarks
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@0057852bfaa89a56745cba8c7296529d2fc39830. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Publish Benchmark Timings
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@0057852bfaa89a56745cba8c7296529d2fc39830. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
benchmark-duration-shard-1
Expired
|
22 KB |
sha256:193d526caefd94347d704f758b93e8e301117ab5bf73296c48f6c39840f37eb4
|
|
|
benchmark-duration-shard-2
Expired
|
21.6 KB |
sha256:ade9e54c098769d73c55c572f6b2f7127ce23e702ee749ce2550c1abc2fa4fc3
|
|
|
benchmark-duration-shard-3
Expired
|
21.8 KB |
sha256:7fdc492194fc6d25619eaad2d774a87b145ed6a0bc9d9912f5528f4595231e6b
|
|
|
benchmark-duration-shard-4
Expired
|
21.6 KB |
sha256:a1c05c449f0705e009f9716f946f192e3f713568c3c831b7be0019c39492fb13
|
|
|
benchmark-host-timing-full-1-of-4
|
842 Bytes |
sha256:9a5cc9dbc9cab0ac52ae51d5e665d79eb1705560b5237b412956a4e48cad812f
|
|
|
benchmark-host-timing-full-2-of-4
|
844 Bytes |
sha256:121b077034677d065728e395bed1640fcae212d578ef714d451115263bd516af
|
|
|
benchmark-host-timing-full-3-of-4
|
844 Bytes |
sha256:d99935711a4a9607b57344df2b2117168c264587e38b86a5ee18e1ed01075938
|
|
|
benchmark-host-timing-full-4-of-4
|
847 Bytes |
sha256:ec4e008cbd11eee3cfcd6f9d9becc23c190ce138f379d55c47bdce2908df6ddf
|
|
|
benchmark-oracle-conjecture-probes-v1-01-of-01
|
84.6 KB |
sha256:a38afa5bfd48420721c41663b7879997cb23267681e587b41d7a735b6015c5e4
|
|
|
benchmark-oracle-mathematical-benchmarks-v1-01-of-04
|
240 KB |
sha256:16ea1098db93bbd902eaf84e307de40e3f5f6ad06a69902ed43424ff67dfbcc4
|
|
|
benchmark-oracle-mathematical-benchmarks-v1-02-of-04
|
254 KB |
sha256:bbfa30ad3c37a1a23ccc08fc39b771dd8ea047a98cd08ead127357920f2c57df
|
|
|
benchmark-oracle-mathematical-benchmarks-v1-03-of-04
|
245 KB |
sha256:a9b2cc676b58bf7e6def119799c053d4372cd86d7830ffd605922e75d0f1545f
|
|
|
benchmark-oracle-mathematical-benchmarks-v1-04-of-04
|
246 KB |
sha256:0ec7810caa3f89f3b3887625d2a5f57f3540b62bde1c7a215ed58d08c7c97031
|
|
|
benchmark-oracle-provider-feasibility-v1-01-of-01
|
58 KB |
sha256:ae4dce15b76b7305ea78c00001ca8182c6c09cbb59a0a5bece1278a80de35224
|
|
|
benchmark-oracle-public-reproductions-v1-01-of-03
|
72.9 KB |
sha256:001867e20f91b1ccf8e275a281265117f2fe69c35c97fc7e10afb023e6035ae3
|
|
|
benchmark-oracle-public-reproductions-v1-02-of-03
|
75.7 KB |
sha256:8a02a82e92e0868a9bb5bedca27c8d31d464570b321868a989829488ea10f1fe
|
|
|
benchmark-oracle-public-reproductions-v1-03-of-03
|
67.5 KB |
sha256:0a1a40d69fd458f787b5ef52655bae75566aa1c647838f5c251ac5bd63751d8e
|
|
|
benchmark-oracle-research-diagnostics-v1-01-of-02
|
78.2 KB |
sha256:2cb5b5deb64a784fb3be123f46573ff26e636096d7ec4965f3ac9fa025cc6aec
|
|
|
benchmark-oracle-research-diagnostics-v1-02-of-02
|
69.7 KB |
sha256:c7bb132dadd54c129407a158c9edd25814e2a261b646897dd847378252035a4f
|
|
|
benchmark-oracle-symbolic-coordination-v1-01-of-03
|
64.2 KB |
sha256:5252b4287ace8c5940a94411e740b75bb10950c7145f2246d89f01aac37529e0
|
|
|
benchmark-oracle-symbolic-coordination-v1-02-of-03
|
72 KB |
sha256:6630cacc53fef3f6180340b2ebabcb6fd5f166932fadc0c26e9912f42a09ba35
|
|
|
benchmark-oracle-symbolic-coordination-v1-03-of-03
|
71.5 KB |
sha256:d8bd5433c978c3d58981c2219924e81993a2d5df09c172eab036012ec7bb49fa
|
|
|
benchmark-plan-receipt
|
27 KB |
sha256:62bb3cd5914620674c18f2fd2247e8ac737e5aa82c6db86f65c168aca1362c12
|
|
|
benchmark-test-durations
|
69.1 KB |
sha256:50371379aa0f8488126807cdb101e3c9e843b3e0c71717ed45a51cec087596ea
|
|
|
benchmark-test-durations-input
Expired
|
69 KB |
sha256:2d19c6189718e606d2fc48f715311afba34b0ec0bbd3703009b659bf1c163413
|
|
|
benchmark-timings-c56fcd4ee45666b952fafad1a2bfc77d854836fe
|
965 Bytes |
sha256:6af580896ba3a4001a99f14b6ef0dc586f93806e19c238907a806bde17461ebf
|
|