Skip to content

Add MBPP evaluator#2439

Open
natke wants to merge 16 commits into
mainfrom
feature/add-mbpp-evaluator
Open

Add MBPP evaluator#2439
natke wants to merge 16 commits into
mainfrom
feature/add-mbpp-evaluator

Merge origin/main into feature/add-mbpp-evaluator: keep eos_token_ids…

47bf207
Select commit
Loading
Failed to load commit list.
GitHub Advanced Security / lintrunner succeeded May 12, 2026 in 10s

15 new alerts

New alerts in code changed by this pull request

  • 15 warnings

See annotations below for details.

View all branch alerts.

Annotations

Check warning on line 665 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 696 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 727 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 755 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 783 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 811 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 847 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 870 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 896 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 915 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 957 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 1002 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 1036 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 1061 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.

Check warning on line 1097 in test/evaluator/test_olive_evaluator.py

See this annotation in the file changed.

Code scanning / lintrunner

PYLINT/W0212 Warning test

Access to a protected member _eos_token_ids of a client class (protected-access)
See protected-access.