Skip to content

debug passk parsing #71

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

Conversation

kanishkg
Copy link

Previously, evaluate gave an error with local execution:

/scr/kanishkg/miniconda3/envs/bcb2/lib/python3.10/site-packages/scipy/__init__.py:146: UserWarning: A NumPy version >=1.16.5 and <1.23.0 is required for this version of SciPy (detected version 1.26.4
  warnings.warn(f"A NumPy version >={np_minversion} and <{np_maxversion}"
Traceback (most recent call last):
  File "/scr/kanishkg/miniconda3/envs/bcb2/bin/bigcodebench.evaluate", line 8, in <module>
    sys.exit(main())
  File "/scr/kanishkg/miniconda3/envs/bcb2/lib/python3.10/site-packages/bigcodebench/evaluate.py", line 432, in main
    Fire(evaluate)
  File "/sailhome/kanishkg/.local/lib/python3.10/site-packages/fire/core.py", line 135, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
  File "/sailhome/kanishkg/.local/lib/python3.10/site-packages/fire/core.py", line 468, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
  File "/sailhome/kanishkg/.local/lib/python3.10/site-packages/fire/core.py", line 684, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
  File "/scr/kanishkg/miniconda3/envs/bcb2/lib/python3.10/site-packages/bigcodebench/evaluate.py", line 209, in evaluate
    passk = [int(k) for k in pass_k.split(",")]
AttributeError: 'tuple' object has no attribute 'split'

this was because pass_k was already parsed and a tuple.
This PR fixes this.

@terryyz
Copy link
Collaborator

terryyz commented Jan 31, 2025

Don't think that the code will lead to such issues on the current main branch..?
The passed pass_k should be a string instead.

@terryyz terryyz closed this Feb 13, 2025
@terryyz terryyz mentioned this pull request Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants