Skip to content

Commit 1b3ebf0

Browse files
committed
feat: flip clawbench-batch default --cases-suite to v2
V2 is the published / supported corpus across claw-bench.com, the README 6-tab leaderboard, the TIGER-Lab/ClawBenchV2Trace HF dataset, and the reproduce CLI's baseline table. Default the batch runner to v2 so any new user invoking `clawbench-batch` without --cases-suite lands on the same corpus that matches our scoring + traces. V1 still works (`--cases-suite v1`) and the V1 NAIL-Group/ClawBenchV1Trace dataset is unchanged.
1 parent 6e21834 commit 1b3ebf0

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/clawbench/runner/batch.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,7 +47,7 @@ def detect_engine() -> str:
4747
"v2": "test-cases/v2",
4848
"v1-lite": "test-cases/v1-lite",
4949
}
50-
DEFAULT_CASES_SUITE = "v1"
50+
DEFAULT_CASES_SUITE = "v2"
5151

5252

5353
def load_models_yaml() -> dict:

0 commit comments

Comments
 (0)