Skip to content

bench format update#1420

Open
sjarvie wants to merge 15 commits intoopen-compass:mainfrom
Specter-Co:sjarvie--bench-format-update
Open

bench format update#1420
sjarvie wants to merge 15 commits intoopen-compass:mainfrom
Specter-Co:sjarvie--bench-format-update

Conversation

@sjarvie
Copy link

@sjarvie sjarvie commented Jan 29, 2026

No description provided.

hil01 builder and others added 15 commits December 5, 2025 10:29
merge changes from source
- Load pre-extracted frames instead of videos
- Pass config_name for Hydra processor instantiation
- Include detection_metadata_paths for BoxCropEventProcessor
- Remove processor config loading (handled by wrapper)

Expected TSV columns: index, video, context, config_name, original_question, answer, rule_id

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants