Skip to content

Add MBPP evaluator#2439

Open
natke wants to merge 16 commits into
mainfrom
feature/add-mbpp-evaluator
Open

Add MBPP evaluator#2439
natke wants to merge 16 commits into
mainfrom
feature/add-mbpp-evaluator

Merge origin/main into feature/add-mbpp-evaluator: keep eos_token_ids…

47bf207
Select commit
Loading
Failed to load commit list.
GitHub Advanced Security / CodeQL succeeded May 12, 2026 in 4s

1 new alert

New alerts in code changed by this pull request

  • 1 warning

See annotations below for details.

View all branch alerts.

Annotations

Check warning on line 584 in olive/evaluator/lmeval_ort.py

See this annotation in the file changed.

Code scanning / CodeQL

Variable defined multiple times Warning

This assignment to 'generate_until' is unnecessary as it is
redefined
before this value is used.