Skip to content

Add an Eval harness #1070

Description

@methedude

Pre-checks

  • I searched existing issues and discussions

What problem are you trying to solve?

A killer feature would be to have an eval harness to run different models and see how they compare to each other across the most popular evals available.

What would you like GenieX to do?

- Add Eval harness that allows the user to select the most popular evals available, as well as custom evals via .json.

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions