Skip to content

Add worker_timeout, label and env to eval suite manifests - #5712

Draft
aconchillo wants to merge 3 commits into
mainfrom
aleix/evals-suite-config
Draft

Add worker_timeout, label and env to eval suite manifests#5712
aconchillo wants to merge 3 commits into
mainfrom
aleix/evals-suite-config

Name the eval suite changelog entries after PR #5712

80d6bf4
Select commit
Loading
Failed to load commit list.
Codecov / codecov/project succeeded Sep 12, 2026 in 1s

62.95% (+0.08%) compared to 6da1714

View this Pull Request on Codecov

62.95% (+0.08%) compared to 6da1714

Details

Codecov Report

❌ Patch coverage is 97.56098% with 1 line in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
src/pipecat/cli/commands/eval.py 66.66% 1 Missing ⚠️
Files with missing lines Coverage Δ
src/pipecat/evals/suite.py 85.87% <100.00%> (+10.48%) ⬆️
src/pipecat/pipeline/worker.py 93.65% <ø> (ø)
src/pipecat/cli/commands/eval.py 59.84% <66.66%> (+0.98%) ⬆️

... and 2 files with indirect coverage changes

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.