Skip to content

Loading local data for custom tasks #681

@ScottHoang

Description

@ScottHoang

Hi team, I am running some eval with generate custom data locally. Is it possible to dynamically add custom tasks with a local file directory? Ideally I would like to be able to do something like:
load_datasets("parquet", data_files="path_to_my_data")
I do not believe data_files is an argument to LightevalTaskConfig ?
Thank you!

Metadata

Metadata

Assignees

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions