Skip to content

Commit 9a26773

Browse files
committed
test(evals): copy threshold resolver dependency
The isolated eval-runner fixtures copied the threshold checker without the fixture resolver it now imports, so valid runner scenarios failed before threshold evaluation. Mirroring the runtime-relative layout keeps those black-box fixtures representative of the real runner.
1 parent 37d1e98 commit 9a26773

1 file changed

Lines changed: 5 additions & 0 deletions

File tree

scripts/tests/evals-run.bats

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,12 @@ setup() {
1414

1515
copy_eval_runner() {
1616
destination="$1"
17+
fixture_root="$(cd "${destination%/*}/../.." && pwd)"
1718
cp "$RUNNER" "$destination"
19+
mkdir -p "$fixture_root/evals/promptfoo"
20+
cp \
21+
"$ROOT/evals/promptfoo/fixtures.cjs" \
22+
"$fixture_root/evals/promptfoo/fixtures.cjs"
1823
cp \
1924
"$ROOT/scripts/evals/provider-compositions.mjs" \
2025
"${destination%/*}/provider-compositions.mjs"

0 commit comments

Comments
 (0)