Skip to content

Add LMEval LLS with custom task tutorial #65

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Add LMEval LLS with custom task tutorial #65

wants to merge 1 commit into from

Conversation

christinaexyou
Copy link
Contributor

This PR makes the following changes:

  • Adds a tutorial demonstrating how to use LM-Eval on LLS with a custom task, specifically, DK-Bench
  • Fixes a typo in the original LM-Eval on LLS tutorial

ruivieira
ruivieira requested changes Jun 24, 2025
View reviewed changes
@ruivieira ruivieira added the documentation Improvements or additions to documentation label Jun 24, 2025
@ruivieira ruivieira moved this to In Review in TrustyAI planning Jun 24, 2025
@ruivieira ruivieira linked an issue Jun 24, 2025 that may be closed by this pull request
Add LMEval LLS with custom task tutorial #66
Open
@christinaexyou christinaexyou force-pushed the add-lmeval-lls-custom-data-tutorial branch from 09c6e67 to d771b75 Compare June 24, 2025 23:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ruivieira ruivieira ruivieira approved these changes

@AmberJBlue AmberJBlue AmberJBlue approved these changes

Assignees
No one assigned
Labels
documentation Improvements or additions to documentation
Projects
TrustyAI planning
Status: In Review
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Add LMEval LLS with custom task tutorial
3 participants
@christinaexyou @ruivieira @AmberJBlue