Skip to content

Releases: mattpocock/evalite

evalite@0.19.0

06 Nov 21:24
64a531d

Choose a tag to compare

Minor Changes

  • d186618: Support custom base paths for static UI exports. Use evalite export --basePath=/your-path to host at non-root URLs like S3/CloudFront subpaths.

evalite@0.18.1

05 Nov 08:54
e04b48f

Choose a tag to compare

Patch Changes

  • e7cfbfb: Fixed a bug where errors at the module level were not being reported

evalite@0.18.0

03 Nov 09:37
e80885e

Choose a tag to compare

Minor Changes

  • 7935f7b: Column functions now receive scores and traces arrays in addition to input, output, and expected, allowing columns to display information from scorers and traces.

evalite@0.17.1

29 Oct 09:40
fdf3b87

Choose a tag to compare

Patch Changes

  • 28fc857: Fixed a bug where errors in data() were not reported

evalite@0.17.0

23 Oct 09:32
6430ab3

Choose a tag to compare

Minor Changes

evalite@0.16.1

19 Oct 15:24
08126a2

Choose a tag to compare

Patch Changes

  • 82e3d86: Fix error logging in watch mode by restoring error details display.

evalite@0.16.0

19 Oct 09:13
3f04516

Choose a tag to compare

Minor Changes

  • edfc4b9: Added setupFiles option to evalite.config.ts for loading environment variables and other setup files before tests run.
  • 88db673: Added evalite.config.ts file to configure Evalite. Added testTimeout and maxConcurrency options.
  • 7cc0d24: trialCount option for running each test case multiple times. Set in evalite.config.ts or per-eval in evalite() call to measure variance in non-deterministic evaluations. Each trial stored as separate result with unique trial_index.

evalite@0.15.0

16 Oct 19:24
075d3cc

Choose a tag to compare

Minor Changes

  • 39fb50e: Migrated to Vitest Annotations API for improved test progress timing. Requires Vitest 3.2.4 or later.

Patch Changes

  • 7aa5927: Removed serialization requirement for eval datasets, allowing non-serializable data like Zod schemas in input/expected fields

evalite@0.14.7

15 Oct 08:19
9d457c1

Choose a tag to compare

Patch Changes

  • ee00ab9: Added collapse functionality to expanded table rows - users can now click 'Show less' to collapse content after expanding it.

evalite@0.14.6

12 Oct 15:35
6abc056

Choose a tag to compare

Patch Changes

  • 9609cc5: Fixed CLI table rendering exceeding terminal width due to incorrect padding calculation