New benchmark tasks, each with a prompt and a `verification_spec` rather than judged prose alone. Owner: @jessie1111101. - [ ] #105 `cve-remediation` and its kind stack - [ ] #106 `spot-rebalancing` and its kind stack - [ ] #107 `migration-and-upgrade` and its stack - [ ] #108 grade what the agent broke on `opa-remediation` Related: #110 hardening `cve-remediation` with layered failure modes.
New benchmark tasks, each with a prompt and a
verification_specrather than judged prose alone. Owner: @jessie1111101.cve-remediationand its kind stackspot-rebalancingand its kind stackmigration-and-upgradeand its stackopa-remediationRelated: #110 hardening
cve-remediationwith layered failure modes.