eval: add observation-only trajectory scoring #1739
cursor[bot]benchmarks.yml
on: pull_request
Plan Benchmarks
30s
Matrix: host_validation
Benchmark Static Quality
20s
Benchmark Contracts, Adapters, Records & Digests
19s
Matrix: oracle
Publish Benchmark Timings
Annotations
2 errors and 1 warning
|
Benchmark Oracle (symbolic-coordination-v1/01-of-03)
Process completed with exit code 2.
|
|
Benchmark Validation
Process completed with exit code 2.
|
|
Plan Benchmarks
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache/restore@0057852bfaa89a56745cba8c7296529d2fc39830. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
benchmark-duration-shard-1
Expired
|
21.8 KB |
sha256:2e38403c34a0d6abb3c9ccc2bca8568161fc82940ccaf1e8c8695d75022bd41e
|
|
|
benchmark-duration-shard-2
Expired
|
21.4 KB |
sha256:5154cb19130cb0b4f647e25ae0ba683e546c142d53f6fe7467880965c9d97ed6
|
|
|
benchmark-duration-shard-3
Expired
|
22 KB |
sha256:ca24c6339242a293eedc96179a4be8a1ec62ae288f1d759032b30d1e4b78fe39
|
|
|
benchmark-duration-shard-4
Expired
|
21.4 KB |
sha256:9966255069efb97275b556b871a9f622c8a1dd3490219abb5fb4d7dca1736cc8
|
|
|
benchmark-host-timing-full-1-of-4
|
844 Bytes |
sha256:816832ec19e80a4aeeb7081e1735ca1c8bd5850483718da19092788a92826ae7
|
|
|
benchmark-host-timing-full-2-of-4
|
844 Bytes |
sha256:38b713408956ae7900bf7dceae851697251547c5c1619c86aac7eb23d14a769f
|
|
|
benchmark-host-timing-full-3-of-4
|
845 Bytes |
sha256:90983f8c6ad4304e91a0b4ac5955c39db715e3c0338ce9043631809e69a3bd5d
|
|
|
benchmark-host-timing-full-4-of-4
|
846 Bytes |
sha256:54b5c9ed1d55bf756c65c9e92ccbf73e899af6d25f7c79249c3204e5e55342dd
|
|
|
benchmark-oracle-conjecture-probes-v1-01-of-01
|
84.6 KB |
sha256:f05bd1321d800ad5633df8e6829d8b1cb709387ddcef41e391a1f0d107366249
|
|
|
benchmark-oracle-mathematical-benchmarks-v1-01-of-04
|
240 KB |
sha256:19633eb0ed451295dde2cd421e2307ec8e18a63cf5910e3418b3022143ad0e02
|
|
|
benchmark-oracle-mathematical-benchmarks-v1-02-of-04
|
254 KB |
sha256:46c561c7e3bce7eb820e5caaacb6eab78c41dbd5194b87c84eba22aa0beded02
|
|
|
benchmark-oracle-mathematical-benchmarks-v1-03-of-04
|
245 KB |
sha256:24d057eac55c51e98695b7c13a8d045091b362acc38cdab8d8d28ed8c9ef65e4
|
|
|
benchmark-oracle-mathematical-benchmarks-v1-04-of-04
|
246 KB |
sha256:14a6bc72af2cb9d1c69f89fdcb9551b1ddd4c48127839fffadc660fa5caa292f
|
|
|
benchmark-oracle-provider-feasibility-v1-01-of-01
|
58 KB |
sha256:3c279dc74d2fc4c1b0ef729bc39a77cb47706e32f7e473cdda1e0c0a417d79cc
|
|
|
benchmark-oracle-public-reproductions-v1-01-of-03
|
72.9 KB |
sha256:54ec9613f9411886bd4118378a1e4f241f280999455421b060637c523b9dccc5
|
|
|
benchmark-oracle-public-reproductions-v1-02-of-03
|
75.7 KB |
sha256:c72d0598e206916fa2419245927a05a2775b8e8e71b2adab2673e6bdcc3ce35d
|
|
|
benchmark-oracle-public-reproductions-v1-03-of-03
|
67.5 KB |
sha256:155293de02b79ae9a54b526e9580c7260a5692d5881775ea621801d80ef898f7
|
|
|
benchmark-oracle-research-diagnostics-v1-01-of-02
|
78.2 KB |
sha256:9050e7e5b9acc31cbcca61a97760020adfa12879fcfc755c5f6d403c4f41f721
|
|
|
benchmark-oracle-research-diagnostics-v1-02-of-02
|
69.6 KB |
sha256:371d56158e02eaf6d856f2270e4f29a8f13c59c81d8457740310d9d71af9ad6a
|
|
|
benchmark-oracle-symbolic-coordination-v1-01-of-03
|
775 Bytes |
sha256:8c407674f09b5060f35248b0003a29f3470e61987197ef310c46cdb062a055e4
|
|
|
benchmark-oracle-symbolic-coordination-v1-02-of-03
|
72 KB |
sha256:e98b26b067374e16a4e0bb32c6a842411145cf66b94d478650153e146b04779e
|
|
|
benchmark-oracle-symbolic-coordination-v1-03-of-03
|
71.5 KB |
sha256:2792448a1287a43f16533260501b317d8a0965a5b0f5eea43288ee87db726eef
|
|
|
benchmark-plan-receipt
|
27 KB |
sha256:84b50345321c703561a03ce7912672da2a4fbfc6d4e0b9be316c7a68ae6b1ccc
|
|
|
benchmark-test-durations-input
Expired
|
69 KB |
sha256:15d847b96f7acab3e91cc88a198d8703912377772bf87629b92cf35c29084a7f
|
|