Skip to content

Reduce terminal noise during benchmark runs - #76

Merged
MaximilianAnzinger merged 3 commits into
mainfrom
chore/clean-cli-output
Aug 24, 2026
Merged

Reduce terminal noise during benchmark runs#76
MaximilianAnzinger merged 3 commits into
mainfrom
chore/clean-cli-output

Conversation

@MaximilianAnzinger

Copy link
Copy Markdown
Collaborator

Summary

  • Remove per-metric insights from terminal output — the detailed qualitative reasoning (which can produce thousands of lines) no longer floods the CLI. It is still written to summary.txt in each run's result directory.
  • Move compliance diagnostics behind --debug — difficulty band checks and instruction adjustment logs in base.py and benchmark.py are now logger.debug() instead of print(), so they appear only when running with --debug (and always in run.log).
  • Keep what matters on screen — per-metric progress lines and the final stats summary table remain unchanged.

Test plan

  • All 199 tests pass
  • Run a benchmark — terminal shows only progress + stats table
  • Verify summary.txt still contains full insights
  • Verify --debug surfaces compliance diagnostics

🤖 Generated with Claude Code

MaximilianAnzinger and others added 2 commits August 24, 2026 19:16
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@MaximilianAnzinger MaximilianAnzinger added this to the 2.0.0 milestone Aug 24, 2026
@MaximilianAnzinger
MaximilianAnzinger merged commit 29b5b40 into main Aug 24, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant