Skip to content

[Benchmark] Add support for SIS-Bench benchmark - #1603

Open
choucisan wants to merge 1 commit into
open-compass:mainfrom
choucisan:feat/add-sis-bench
Open

[Benchmark] Add support for SIS-Bench benchmark#1603
choucisan wants to merge 1 commit into
open-compass:mainfrom
choucisan:feat/add-sis-bench

Conversation

@choucisan

Copy link
Copy Markdown

Register SIS-Bench in the VLMEvalKit video dataset registry.

Support SIS-Bench evaluation under 8-frame, 32-frame, and 1-FPS settings, with overall, spatial cognition, self-awareness, and 13 task-level accuracy metrics.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant