-
Notifications
You must be signed in to change notification settings - Fork 28
Description
I failed on the given example with a typeerror.
TypeError Traceback (most recent call last)
Cell In[1], line 6
3 prediction = "def add ( a , b ) :\n return a + b"
4 reference = "def sum ( first , second ) :\n return second + first"
----> 6 result = calc_codebleu([reference], [prediction], lang="python", weights=(0.25, 0.25, 0.25, 0.25), tokenizer=None)
7 print(result)
File d:\cc\LLM_DynaEval_Coding\mbpp+\codebleu\codebleu.py:41, in calc_codebleu(references, predictions, lang, weights, tokenizer, keywords_dir)
38 assert keywords_dir.exists(), f"keywords_dir {keywords_dir} does not exist"
40 # get the tree-sitter language for a given language
---> 41 tree_sitter_language = get_tree_sitter_language(lang)
43 # preprocess inputs
44 references = [[x.strip() for x in ref] if isinstance(ref, list) else [ref.strip()] for ref in references]
File d:\cc\LLM_DynaEval_Coding\mbpp+\codebleu\utils.py:163, in get_tree_sitter_language(lang)
160 elif lang == "python":
161 import tree_sitter_python
--> 163 return Language(tree_sitter_python.language())
164 elif lang == "go":
165 import tree_sitter_go
TypeError: an integer is required