Description
Hi team, I am running some eval with generate custom data locally. Is it possible to dynamically add custom tasks with a local file directory? Ideally I would like to be able to do something like:
load_datasets("parquet", data_files="path_to_my_data")
I do not believe data_files
is an argument to LightevalTaskConfig
?
Thank you!