Fixes for BigCodeBench Evaluator #3310

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

yifanmai merged 3 commits into main from yifanmai/bigcodebench-evaluator

Feb 5, 2025

Collaborator

yifanmai commented Feb 4, 2025

Allow using a cloned evaluator instance
Allow using the selective_evaluate parameter for downsampling instances
Remove extra_data from instances
Misc style fixes

yifanmai added 3 commits

February 4, 2025 13:54


          Fixes

ce6ef5c


          Fixes


          Add back retry

fa130b1

yifanmai requested a review from liamjxu

February 4, 2025 22:15

yifanmai merged commit bfaa13a into main

8 checks passed

yifanmai deleted the yifanmai/bigcodebench-evaluator branch

February 5, 2025 19:24

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet