Skip to content

[Feature] expand mcq eval judge model support and fix single-image PNG saving#1431

Open
PeterWangyi wants to merge 2 commits intoopen-compass:mainfrom
PeterWangyi:pr-fix-misc
Open

[Feature] expand mcq eval judge model support and fix single-image PNG saving#1431
PeterWangyi wants to merge 2 commits intoopen-compass:mainfrom
PeterWangyi:pr-fix-misc

Conversation

@PeterWangyi
Copy link

Feature:

  • Expand image mcq class judge model support

Fix:

  • Save single image as png to align with multi image format

PeterWangyi and others added 2 commits February 3, 2026 12:20
… fix single-image PNG saving (open-compass#32)

* [Feature] Add MMSI-Video-Bench

* [Fix] save fingle img as png like that in multi imgs.

* [Refactor] refactor according to copilot

* [Feature] Expand openai judge models for mcq dataset class

* [Feature] Specify judge model name in acc file name

* [Refactor] refactor according to copilot

* [Fix] lmudata error
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant