Skip to content

Latest commit

 

History

History
1 lines (1 loc) · 619 Bytes

File metadata and controls

1 lines (1 loc) · 619 Bytes
  • A suite entry can carry a label: and an env:. The label names the entry in the dashboard, the failure and pass-rate summaries, results.jsonl (a new "label" field; "bot" still holds the path) and the artifact filenames, where it is made filesystem-safe, and -p/--pattern matches it as well as the bot path; env: is added to the spawned bot's environment over the suite's own. Together they let one bot file run under several configurations (a model, a reasoning effort) as separate entries whose logs and recordings do not overwrite each other. EvalRun gains label (default: the bot path) and env.