Release BigCodeBench v0.1.8

terryyz released this 17 Jul 20:11

· 264 commits to main since this release

32f5382

Features:

Support BigCodeBench-Hard subset: #17
Identify and fix tokenizer setup: #21
Customize the tokenizer: #20
Add the pass rate result log: #20

Contributors:

@marianna13: #20

Models：

A total of 96 models at the time of the release

Acknowledgement:

Full Changelog: v0.1.7...v0.1.8

Contributors

takkyu2, imamnurby, and 2 other contributors

Assets 2