-
Notifications
You must be signed in to change notification settings - Fork 10
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
add: new eval results with correct parsing
- Loading branch information
Showing
28 changed files
with
861,349 additions
and
619 deletions.
There are no files selected for viewing
Large diffs are not rendered by default.
Oops, something went wrong.
129,910 changes: 129,910 additions & 0 deletions
129,910
results/CodeLlama-7b-hf_completions_open-eval.py
Large diffs are not rendered by default.
Oops, something went wrong.
Large diffs are not rendered by default.
Oops, something went wrong.
83,631 changes: 83,631 additions & 0 deletions
83,631
results/CodeQwen1.5-7B-Chat_completions_open-eval.py
Large diffs are not rendered by default.
Oops, something went wrong.
2 changes: 1 addition & 1 deletion
2
results/OpenCodeInterpreter-DS-6.7B_completions_open-eval.jsonl
Large diffs are not rendered by default.
Oops, something went wrong.
82,730 changes: 82,730 additions & 0 deletions
82,730
results/OpenCodeInterpreter-DS-6.7B_completions_open-eval.py
Large diffs are not rendered by default.
Oops, something went wrong.
538 changes: 538 additions & 0 deletions
538
results/_gpt-4-turbo-2024-04-09_completions_open-eval.jsonl
Large diffs are not rendered by default.
Oops, something went wrong.
4 changes: 2 additions & 2 deletions
4
results/deepseek-coder-6.7b-instruct_completions_open-eval.jsonl
Large diffs are not rendered by default.
Oops, something went wrong.
90,972 changes: 90,972 additions & 0 deletions
90,972
results/deepseek-coder-6.7b-instruct_completions_open-eval.py
Large diffs are not rendered by default.
Oops, something went wrong.
Large diffs are not rendered by default.
Oops, something went wrong.
70,733 changes: 70,733 additions & 0 deletions
70,733
results/gpt-3.5-turbo-0125_completions_open-eval.py
Large diffs are not rendered by default.
Oops, something went wrong.
628 changes: 314 additions & 314 deletions
628
results/gpt-4-turbo-2024-04-09_completions_open-eval.jsonl
Large diffs are not rendered by default.
Oops, something went wrong.
61,545 changes: 61,545 additions & 0 deletions
61,545
results/gpt-4-turbo-2024-04-09_completions_open-eval.py
Large diffs are not rendered by default.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| {"f_885": false, "f_275": false, "f_388": false, "f_535": false, "f_1760": true, "f_1895": false, "f_609": true, "f_820": false, "f_813": false, "f_836": false, "f_842": false, "f_284": false, "f_397": false, "f_3883": true, "f_781": false, "f_383": false, "f_818": false, "f_327": false, "f_532": false, "f_806": false, "f_350": false, "f_288": false, "f_414": false, "f_890": false, "f_402": false, "f_914": false, "f_773": false, "f_587": false, "f_909": false, "f_245": false, "f_1715": false, "f_805": false, "f_2260": false, "f_2726": false, "f_811": false, "f_2439": false, "f_875": false, "f_425": false, "f_298": false, "f_244": false, "f_1730": false, "f_408": false, "f_303": false, "f_332": false, "f_389": false, "f_931": false, "f_753": false, "f_822": false, "f_221": false, "f_882": false, "f_405": false, "f_4434": false, "f_403": false, "f_378": false, "f_349": true, "f_377": false, "f_761": false, "f_3993": false, "f_330": true, "f_227": false, "f_274": true, "f_874": false, "f_886": false, "f_736": false, "f_304": true, "f_866": false, "f_353": false, "f_851": false, "f_399": false, "f_225": false, "f_612": true, "f_294": false, "f_918": false, "f_777": false, "f_337": false, "f_803": false, "f_889": false, "f_830": false, "f_3957": true, "f_903": false, "f_417": false, "f_834": false, "f_791": true, "f_333": false, "f_394": false, "f_928": false, "f_219": false, "f_4530": false, "f_264": true, "f_2321": true, "f_794": false, "f_335": false, "f_536": false, "f_246": false, "f_790": false, "f_608": false, "f_804": false, "f_560": false, "f_837": true, "f_740": false, "f_869": false, "f_580": false, "f_528": true, "f_413": false, "f_917": false, "f_542": false, "f_847": false, "f_534": false, "f_422": true, "f_541": false, "f_530": false, "f_334": false, "f_752": false, "f_838": false, "f_257": false, "f_366": false, "f_1737": false, "f_310": false, "f_4395": false, "f_3033": false, "f_899": false, "f_416": false, "f_372": false, "f_392": false, "f_755": false, "f_796": false, "f_407": false, "f_351": true, "f_3307": false, "f_891": false, "f_744": false, "f_2707": false, "f_841": false, "f_396": false, "f_276": false, "f_1752": false, "f_539": false, "f_3979": false, "f_239": false, "f_924": false, "f_354": false, "f_757": false, "f_418": false, "f_401": false, "f_1764": false, "f_778": false, "f_764": false, "f_338": false, "f_871": false, "f_3322": false, "f_390": false, "f_273": true, "f_759": false, "f_3670": false, "f_756": false, "f_860": true, "f_832": false, "f_272": false, "f_395": false, "f_831": false, "f_1896": false, "f_921": false, "f_291": false, "f_913": false, "f_290": false, "f_1731": false, "f_419": false, "f_900": false, "f_1712": false, "f_932": false, "f_1754": true, "f_248": false, "f_864": false, "f_344": false, "f_746": false, "f_256": false, "f_2661": false, "f_745": false, "f_545": true, "f_385": false, "f_2065": false, "f_282": false, "f_870": false, "f_827": false, "f_906": false, "f_278": false, "f_543": false, "f_923": false, "f_328": false, "f_741": false, "f_2846": false, "f_252": false, "f_295": false, "f_879": false, "f_795": false, "f_897": false, "f_916": false, "f_765": false, "f_400": false, "f_610": true, "f_241": true, "f_343": false, "f_748": false, "f_787": false, "f_557": true, "f_329": true, "f_1710": false, "f_380": false, "f_4529": false, "f_371": false, "f_776": false, "f_611": false, "f_4215": false, "f_342": true, "f_898": false, "f_538": false, "f_1716": false, "f_862": false, "f_1767": false, "f_550": true, "f_253": true, "f_363": false, "f_856": false, "f_784": false, "f_265": false, "f_331": false, "f_237": false, "f_3288": false, "f_3671": true, "f_564": true, "f_3049": true, "f_775": false, "f_801": false, "f_3960": false, "f_760": false, "f_825": false, "f_1768": false, "f_1729": false, "f_1709": false, "f_592": false, "f_373": false, "f_391": false, "f_1894": false, "f_529": false, "f_340": false, "f_285": false, "f_4495": false, "f_360": false, "f_411": false, "f_379": false, "f_824": false, "f_406": false, "f_888": false, "f_307": false, "f_892": false, "f_763": false, "f_362": false, "f_3325": false, "f_817": false, "f_2296": false, "f_384": false, "f_537": false, "f_861": false, "f_904": false, "f_769": true, "f_1897": false, "f_780": true, "f_867": false, "f_561": true, "f_424": false, "f_266": false, "f_845": false, "f_4526": false, "f_808": false, "f_301": false, "f_421": false, "f_1711": false, "f_232": false, "f_426": false, "f_1757": false, "f_749": false, "f_287": false, "f_922": false, "f_4528": false, "f_920": false, "f_926": false, "f_1732": false, "f_243": true, "f_797": false, "f_814": false, "f_2407": false, "f_835": false, "f_531": true, "f_2295": false, "f_3115": false, "f_1701": false, "f_598": false, "f_544": true, "f_549": true, "f_223": true, "f_739": false, "f_235": false, "f_782": false, "f_2099": false, "f_1755": false, "f_289": false, "f_3589": false, "f_336": false, "f_3036": false, "f_743": false, "f_4590": false, "f_260": false, "f_4391": false, "f_409": false, "f_857": false, "f_546": true, "f_4444": false, "f_271": false, "f_767": true, "f_312": false, "f_375": false, "f_300": false, "f_747": false, "f_357": false, "f_768": false, "f_296": false, "f_279": false, "f_249": true, "f_358": true, "f_2658": false, "f_318": false, "f_1713": false, "f_3037": false, "f_1750": false, "f_527": false, "f_563": true, "f_346": false, "f_1751": false, "f_359": false, "f_220": false, "f_925": false, "f_774": false, "f_302": false, "f_859": false, "f_339": false, "f_283": false, "f_840": false, "f_802": false, "f_798": false, "f_4313": false, "f_1724": false, "f_848": false, "f_293": false, "f_812": false, "f_742": false, "f_582": true, "f_412": false, "f_3667": true, "f_297": false, "f_368": false, "f_286": false, "f_819": false, "f_751": false, "f_2971": true, "f_771": false, "f_374": false, "f_4212": false, "f_823": false, "f_2703": false, "f_734": false, "f_365": false, "f_526": true, "f_299": false, "f_588": true, "f_894": false, "f_280": false, "f_352": false, "f_793": false, "f_267": false, "f_772": false, "f_4432": false, "f_1717": false, "f_919": false, "f_355": false, "f_910": false, "f_2250": false, "f_849": false, "f_4445": false, "f_565": false, "f_807": false, "f_309": true, "f_2248": false, "f_3591": false, "f_786": false, "f_224": false, "f_853": false, "f_911": false, "f_738": true, "f_4433": true, "f_854": true, "f_270": false, "f_420": false, "f_788": false, "f_387": false, "f_324": false, "f_218": false, "f_750": false, "f_4527": false, "f_572": true, "f_410": false, "f_381": false, "f_2092": false, "f_3995": false, "f_783": true, "f_367": false, "f_281": false, "f_865": false, "f_217": false, "f_2970": true, "f_3588": true, "f_2842": false, "f_735": false, "f_305": false, "f_844": false, "f_348": false, "f_4492": false, "f_927": false, "f_800": false, "f_277": false, "f_785": false, "f_585": true, "f_341": false, "f_255": false, "f_829": false, "f_872": false, "f_799": false, "f_4442": false, "f_4441": false, "f_883": false, "f_321": false, "f_858": false, "f_356": false, "f_893": false, "f_4435": false, "f_316": false, "f_247": true, "f_816": false, "f_251": true, "f_347": false, "f_222": true, "f_398": false, "f_839": false, "f_376": false, "f_3324": false, "f_855": false, "f_589": false, "f_770": false, "f_4669": false, "f_868": false, "f_895": false, "f_809": false, "f_559": false, "f_843": true, "f_326": false, "f_852": false, "f_1765": false, "f_930": false, "f_758": false, "f_737": false, "f_364": false, "f_896": false, "f_369": false, "f_887": false, "f_789": false, "f_533": false, "f_3980": false, "f_908": false, "f_317": false, "f_292": false, "f_240": false, "f_792": true, "f_4278": false, "f_540": true, "f_263": false, "f_905": false, "f_345": false, "f_850": false, "f_315": false, "f_915": false, "f_810": false, "f_404": false, "f_370": false, "f_826": false, "f_259": false, "f_382": false, "f_762": false, "f_254": false, "f_912": false, "f_929": false, "f_873": true, "f_3392": true, "f_423": false, "f_766": false, "f_386": false, "f_907": false, "f_815": false, "f_876": false, "f_586": false, "f_593": false, "f_361": false, "f_754": true, "f_884": false, "f_833": false, "f_262": false, "f_415": false, "f_821": false, "f_393": false, "f_878": false, "f_258": false, "f_242": false, "f_863": false, "f_558": false, "f_308": true, "f_250": false, "f_901": false, "f_881": true, "f_828": false, "f_902": false, "f_846": false, "f_581": false, "f_311": true, "f_877": false} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1 @@ | ||
| {"f_885": false, "f_275": false, "f_388": false, "f_535": false, "f_1760": true, "f_1895": false, "f_609": true, "f_820": true, "f_813": false, "f_836": false, "f_842": true, "f_284": true, "f_397": false, "f_3883": true, "f_781": false, "f_383": false, "f_818": false, "f_327": true, "f_532": true, "f_806": false, "f_350": true, "f_288": false, "f_414": false, "f_890": false, "f_402": true, "f_914": true, "f_773": false, "f_587": true, "f_909": true, "f_245": true, "f_1715": false, "f_805": false, "f_2260": false, "f_2726": true, "f_811": false, "f_2439": false, "f_875": true, "f_425": false, "f_298": true, "f_244": false, "f_1730": true, "f_408": true, "f_303": true, "f_332": false, "f_389": true, "f_931": false, "f_753": true, "f_822": true, "f_221": true, "f_882": true, "f_405": true, "f_4434": true, "f_403": false, "f_378": false, "f_349": true, "f_377": false, "f_761": true, "f_3993": true, "f_330": true, "f_227": false, "f_274": true, "f_874": true, "f_886": false, "f_736": false, "f_304": true, "f_866": false, "f_353": true, "f_851": false, "f_399": false, "f_225": false, "f_612": true, "f_294": false, "f_918": false, "f_777": false, "f_337": true, "f_803": true, "f_889": false, "f_830": false, "f_3957": true, "f_903": false, "f_417": true, "f_834": true, "f_791": true, "f_333": true, "f_394": false, "f_928": false, "f_219": true, "f_4530": true, "f_264": false, "f_2321": true, "f_794": false, "f_335": false, "f_536": true, "f_246": false, "f_790": false, "f_608": false, "f_804": false, "f_560": false, "f_837": true, "f_740": true, "f_869": false, "f_580": false, "f_528": false, "f_413": false, "f_917": false, "f_542": false, "f_847": false, "f_534": false, "f_422": true, "f_541": false, "f_530": true, "f_334": true, "f_752": false, "f_838": false, "f_257": false, "f_366": false, "f_1737": false, "f_310": false, "f_4395": true, "f_3033": true, "f_899": false, "f_416": false, "f_372": false, "f_392": true, "f_755": false, "f_796": true, "f_407": false, "f_351": true, "f_3307": true, "f_891": false, "f_744": true, "f_2707": false, "f_841": true, "f_396": false, "f_276": false, "f_1752": false, "f_539": true, "f_3979": false, "f_239": false, "f_924": true, "f_354": false, "f_757": false, "f_418": false, "f_401": false, "f_1764": true, "f_778": false, "f_764": false, "f_338": true, "f_871": false, "f_3322": false, "f_390": false, "f_273": false, "f_759": false, "f_3670": true, "f_756": false, "f_860": true, "f_832": false, "f_272": false, "f_395": false, "f_831": false, "f_1896": true, "f_921": true, "f_291": true, "f_913": false, "f_290": true, "f_1731": true, "f_419": false, "f_900": false, "f_1712": false, "f_932": true, "f_1754": true, "f_248": true, "f_864": true, "f_344": false, "f_746": false, "f_256": false, "f_2661": false, "f_745": false, "f_545": true, "f_385": false, "f_2065": false, "f_282": true, "f_870": true, "f_827": true, "f_906": true, "f_278": false, "f_543": false, "f_923": false, "f_328": true, "f_741": false, "f_2846": false, "f_252": false, "f_295": false, "f_879": false, "f_795": false, "f_897": false, "f_916": true, "f_765": true, "f_400": false, "f_610": true, "f_241": true, "f_343": false, "f_748": false, "f_787": false, "f_557": true, "f_329": true, "f_1710": false, "f_380": false, "f_4529": true, "f_371": false, "f_776": false, "f_611": false, "f_4215": false, "f_342": true, "f_898": false, "f_538": true, "f_1716": false, "f_862": false, "f_1767": false, "f_550": true, "f_253": true, "f_363": false, "f_856": false, "f_784": false, "f_265": false, "f_331": false, "f_237": false, "f_3288": true, "f_3671": true, "f_564": true, "f_3049": true, "f_775": true, "f_801": false, "f_3960": false, "f_760": false, "f_825": false, "f_1768": false, "f_1729": false, "f_1709": true, "f_592": false, "f_373": false, "f_391": true, "f_1894": true, "f_529": true, "f_340": true, "f_285": true, "f_4495": true, "f_360": false, "f_411": true, "f_379": false, "f_824": true, "f_406": true, "f_888": false, "f_307": true, "f_892": true, "f_763": true, "f_362": false, "f_3325": false, "f_817": true, "f_2296": false, "f_384": false, "f_537": false, "f_861": false, "f_904": false, "f_769": true, "f_1897": false, "f_780": true, "f_867": false, "f_561": true, "f_424": false, "f_266": true, "f_845": true, "f_4526": false, "f_808": false, "f_301": false, "f_421": false, "f_1711": true, "f_232": true, "f_426": false, "f_1757": false, "f_749": true, "f_287": false, "f_922": true, "f_4528": false, "f_920": false, "f_926": false, "f_1732": true, "f_243": true, "f_797": true, "f_814": false, "f_2407": true, "f_835": true, "f_531": true, "f_2295": true, "f_3115": false, "f_1701": false, "f_598": true, "f_544": true, "f_549": true, "f_223": true, "f_739": false, "f_235": false, "f_782": true, "f_2099": true, "f_1755": true, "f_289": false, "f_3589": false, "f_336": false, "f_3036": false, "f_743": false, "f_4590": false, "f_260": false, "f_4391": false, "f_409": false, "f_857": false, "f_546": true, "f_4444": false, "f_271": false, "f_767": true, "f_312": true, "f_375": false, "f_300": false, "f_747": true, "f_357": true, "f_768": true, "f_296": false, "f_279": false, "f_249": true, "f_358": true, "f_2658": false, "f_318": true, "f_1713": true, "f_3037": false, "f_1750": true, "f_527": false, "f_563": true, "f_346": false, "f_1751": true, "f_359": false, "f_220": false, "f_925": true, "f_774": false, "f_302": false, "f_859": false, "f_339": false, "f_283": false, "f_840": false, "f_802": true, "f_798": false, "f_4313": true, "f_1724": false, "f_848": false, "f_293": true, "f_812": false, "f_742": false, "f_582": false, "f_412": false, "f_3667": true, "f_297": false, "f_368": false, "f_286": false, "f_819": true, "f_751": true, "f_2971": true, "f_771": true, "f_374": true, "f_4212": true, "f_823": false, "f_2703": false, "f_734": false, "f_365": false, "f_526": true, "f_299": true, "f_588": true, "f_894": true, "f_280": false, "f_352": true, "f_793": false, "f_267": true, "f_772": false, "f_4432": false, "f_1717": false, "f_919": false, "f_355": false, "f_910": false, "f_2250": false, "f_849": false, "f_4445": false, "f_565": true, "f_807": false, "f_309": false, "f_2248": false, "f_3591": true, "f_786": false, "f_224": false, "f_853": true, "f_911": false, "f_738": false, "f_4433": true, "f_854": true, "f_270": true, "f_420": false, "f_788": false, "f_387": false, "f_324": false, "f_218": true, "f_750": true, "f_4527": false, "f_572": true, "f_410": false, "f_381": false, "f_2092": false, "f_3995": false, "f_783": false, "f_367": true, "f_281": false, "f_865": false, "f_217": false, "f_2970": false, "f_3588": true, "f_2842": false, "f_735": false, "f_305": false, "f_844": false, "f_348": false, "f_4492": true, "f_927": true, "f_800": false, "f_277": false, "f_785": false, "f_585": true, "f_341": true, "f_255": true, "f_829": true, "f_872": true, "f_799": false, "f_4442": true, "f_4441": true, "f_883": false, "f_321": false, "f_858": false, "f_356": true, "f_893": true, "f_4435": false, "f_316": false, "f_247": true, "f_816": false, "f_251": false, "f_347": false, "f_222": true, "f_398": false, "f_839": false, "f_376": false, "f_3324": true, "f_855": false, "f_589": false, "f_770": false, "f_4669": false, "f_868": false, "f_895": true, "f_809": true, "f_559": true, "f_843": true, "f_326": false, "f_852": false, "f_1765": true, "f_930": true, "f_758": false, "f_737": false, "f_364": false, "f_896": false, "f_369": false, "f_887": false, "f_789": false, "f_533": true, "f_3980": true, "f_908": true, "f_317": false, "f_292": false, "f_240": false, "f_792": true, "f_4278": false, "f_540": true, "f_263": true, "f_905": false, "f_345": false, "f_850": false, "f_315": false, "f_915": false, "f_810": false, "f_404": true, "f_370": true, "f_826": false, "f_259": false, "f_382": false, "f_762": true, "f_254": true, "f_912": false, "f_929": true, "f_873": true, "f_3392": true, "f_423": false, "f_766": false, "f_386": false, "f_907": false, "f_815": false, "f_876": true, "f_586": true, "f_593": false, "f_361": false, "f_754": true, "f_884": false, "f_833": true, "f_262": true, "f_415": false, "f_821": false, "f_393": false, "f_878": true, "f_258": false, "f_242": false, "f_863": false, "f_558": true, "f_308": true, "f_250": true, "f_901": false, "f_881": true, "f_828": false, "f_902": false, "f_846": false, "f_581": false, "f_311": true, "f_877": false} |
Oops, something went wrong.