Fail to Evaluate Model on human_eval

[yjw1029]

Command:

python main.py human_eval --model_name seq_to_seq --model_path google/flan-t5-small

Error:

Traceback (most recent call last):
  File "main.py", line 98, in <module>
    Fire(main)
  File "/usr/local/lib/python3.8/dist-packages/fire/core.py", line 141, in Fire
    component_trace = _Fire(component, args, parsed_flag_args, context, name)
  File "/usr/local/lib/python3.8/dist-packages/fire/core.py", line 475, in _Fire
    component, remaining_args = _CallAndUpdateTrace(
  File "/usr/local/lib/python3.8/dist-packages/fire/core.py", line 691, in _CallAndUpdateTrace
    component = fn(*varargs, **kwargs)
  File "main.py", line 23, in main
    score = task_fn(**kwargs)
  File "/instruct-eval/human_eval/main.py", line 117, in main
    result = evaluate(model, data_path, **kwargs)
  File "/instruct-eval/human_eval/main.py", line 89, in evaluate
    completion = model.run(prompt, temperature=temperature, do_sample=True)
  File "/instruct-eval/modeling.py", line 156, in run
    outputs = self.model.generate(
TypeError: generate() got multiple values for keyword argument 'do_sample'

[chiayewken]

Thanks for raising this issue, we have pushed the fix