Skip to content

Pull requests: open-compass/opencompass

New pull request New
59 Open 1,142 Closed
59 Open 1,142 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Feature] Support pass@1 evaluation for multi predictions in MathEvaluator
#2253 opened Aug 28, 2025 by DELEnomore Loading…
@acylam
2
[Bump] Bump version to 0.5.0
#2251 opened Aug 27, 2025 by Myhs-phz Loading…
[Update] compassbench subjective config
#2238 opened Aug 14, 2025 by Myhs-phz Loading…
@acylam
feat: Add Zebra Grid dataset support with ZeroEval alignment
#2234 opened Aug 11, 2025 by max-yue Loading…
@bittersweet1999
[fix] switch think mode
#2233 opened Aug 10, 2025 by Tianhao-Peng Loading…
2 of 6 tasks
@tonysy
[Fix] add tqdm for BlueLMAPI
#2226 opened Aug 1, 2025 by Myhs-phz Loading…
@tonysy
[Feature] Support eval for C-Eval test split
#2218 opened Jul 24, 2025 by HYZ17 Loading…
@acylam
1
[Fix] Modify error handling and fix typo
#2216 opened Jul 24, 2025 by Owen-Qin Loading…
@acylam
[Fix] In cascaded evaluation, the return value is None when the rule evaluation is 100% correct.
#2211 opened Jul 21, 2025 by jibuzixin Loading…
1
[Fix] Deprecate unused and error formated math500 gen file
#2206 opened Jul 17, 2025 by liushz Loading…
6 tasks
@acylam
[Fix] livecodebench serialization and timeout errors
#2204 opened Jul 15, 2025 by f14-bertolotti Loading…
6 tasks
@liushz
fix bug in openai_api
#2200 opened Jul 11, 2025 by LKJacky Loading…
@tonysy
[Dataset] Add new dataset BeyondAIME
#2192 opened Jul 9, 2025 by Myhs-phz Loading…
6 tasks
@MaiziXiao
1
ruler os.environ fix
#2191 opened Jul 9, 2025 by f14-bertolotti Loading…
@MaiziXiao
feat:enhanced mbpp process answer patterns
#2187 opened Jul 8, 2025 by ShikangPang Loading…
6 tasks
@liushz
[fix] Update README.md with a typo
#2177 opened Jul 1, 2025 by ktwu01 Loading…
@liushz
[Fix] Update LCBench
#2166 opened Jun 25, 2025 by Myhs-phz Loading…
@MaiziXiao
2
Add GrandPhysics dataset
#2118 opened May 26, 2025 by Xiao-Youth Loading…
1 of 6 tasks
@bittersweet1999
3
PromptCBLUE:Life Science dataset
#2073 opened May 4, 2025 by tchenglv520 Loading…
6 tasks done
@tonysy
Fix mkdir hardcode in runners and partitioners
#2060 opened Apr 28, 2025 by BIGWangYuDong Loading…
@bittersweet1999
3
fix llm judge evaluator import and docs
#2057 opened Apr 27, 2025 by smgjch Loading…
@tonysy
1
[Dataset]Add GAIA Datasets
#2051 opened Apr 26, 2025 by domonic18 Loading…
1 of 6 tasks
@tonysy
[Feature] Support AntFinix LLM
#2043 opened Apr 24, 2025 by xsq2060 Loading…
@acylam
replace the model name for new version of bailing
#2034 opened Apr 23, 2025 by cuauty Loading…
6 tasks done
@MaiziXiao
1
[Dataset] Add SeedBench Dataset
#2020 opened Apr 14, 2025 by ChenZiHong-Gavin Loading…
5 tasks done
@bittersweet1999
6
ProTip! Updated in the last three days: updated:>2025-08-28.