Skip to content

Issues: huggingface/lighteval

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
20 Open 18 Closed
20 Open 18 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Adds GSM-PLUS new-task
#780 opened May 23, 2025 by NathanHB Loading…
1
@NathanHB
4
[EVAL] GSM Plus new-task
#778 opened May 23, 2025 by NathanHB
1
@NathanHB
[EVAL] TauBench: help wanted Extra attention is needed new-task
#741 opened May 19, 2025 by NathanHB
[EVAL] SciCode: reasearch coding benchmark help wanted Extra attention is needed new-task
#740 opened May 19, 2025 by NathanHB
[EVAL] HELMET: long context evals help wanted Extra attention is needed new-task
#731 opened May 15, 2025 by NathanHB
[EVAL] SWEBENCH multilingual help wanted Extra attention is needed new-task
#730 opened May 15, 2025 by NathanHB
[EVAL] Add RULER for evaluating long context new-task
#726 opened May 15, 2025 by NathanHB
1
@NathanHB
Adds RULER benchmark new-task
#722 opened May 15, 2025 by NathanHB Loading…
1
12
Call for contributions: Translate lighteval's doc into Chinese good first issue Good for newcomers help wanted Extra attention is needed new-task
#716 opened May 14, 2025 by clefourrier
2
[EVAL] Adding PHARE good first issue Good for newcomers help wanted Extra attention is needed new-task
#696 opened Apr 30, 2025 by clefourrier
@nsbg
6
[EVAL] Big-Bench Extra Hard (BBEH) good first issue Good for newcomers help wanted Extra attention is needed new-task
#600 opened Mar 3, 2025 by lewtun
[EVAL] Add TUMLU benchmark good first issue Good for newcomers help wanted Extra attention is needed new-task
#577 opened Feb 19, 2025 by gaydmi
10
Add CodeElo new-task
#575 opened Feb 19, 2025 by plaguss • Draft
1
[EVAL] Add JGLUE Test new-task
#455 opened Dec 18, 2024 by ryan-minato
2
[EVAL]: Add more African Benchmarks good first issue Good for newcomers help wanted Extra attention is needed new-task
#373 opened Oct 24, 2024 by dadelani
4
[EVAL] Add ArenaHardAuto new-task prio
#325 opened Sep 23, 2024 by lewtun
[EVAL] Add RewardBench new-task
#324 opened Sep 23, 2024 by lewtun
2
[New Task] Add AlpacaEval LC feature/enhancement New feature/request new-task
#139 opened Apr 2, 2024 by YannDubs
10
Add EQ Bench new-task
#114 opened Mar 18, 2024 by lewtun
1
Add HumanEval and HumanEval+ new-task
#63 opened Feb 27, 2024 by lewtun
1
ProTip! no:milestone will show everything without a milestone.