Skip to content

Pull requests: EvolvingLMMs-Lab/lmms-eval

New pull request New
10 Open 578 Closed
10 Open 578 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat(tasks): add MMVP task with ground truth corrections
#1028 opened Jan 22, 2026 by Luodian Loading…
feat: add WenetSpeech test_net split for evaluation
#1027 opened Jan 22, 2026 by Luodian Loading…
1
fix: add resource cleanup in video loaders to prevent memory leaks
#1026 opened Jan 22, 2026 by Luodian Loading…
1
fix: replace hardcoded .cuda() with .to(self._device) for multi-GPU support
#1024 opened Jan 22, 2026 by Luodian Loading…
1
1
feat: add VLMEvalKit-compatible Qwen task variants for MMMU and MMStar
#1021 opened Jan 22, 2026 by Luodian Loading…
2
fix: add version-aware audio loading for datasets >= 4.0 compatibility
#1020 opened Jan 22, 2026 by Luodian Loading…
1
1
fix: add guards for empty video frames in load_video utilities
#1019 opened Jan 22, 2026 by Luodian Loading…
1
add kris_bench task
#1017 opened Jan 22, 2026 by KemingWu Loading…
4
[feat] Add Power Analysis for Pre-Evaluation Planning
#1007 opened Jan 19, 2026 by mwxely Loading…
4
[Release] v0.6 Development Branch - TUI, CLT/Clustered SE, Paired T-Test, Power Analysis, Stability Metrics, Decontamination, Import Refactor
#1001 opened Jan 17, 2026 by Luodian Loading…
3
ProTip! Updated in the last three days: updated:>2026-01-19.