Skip to content

Conversation

@yeomjy
Copy link

@yeomjy yeomjy commented Mar 10, 2025

  1. load_dataset(HF_DATASET[args.dataset], ...) -> load_dataset('json', data_files=HF_DATASET[args.dataset], ...) for each evaluation code
  2. Current mbpp_intrinsic_eval.py loads hard dataset when not args.hard. Fixed this.
  3. In mbpp_utdebug.py, unused code_src = load_dataset(...) variable exists and makes an error. Removed this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant