8000 Loading local data for custom tasks · Issue #681 · huggingface/lighteval · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
Loading local data for custom tasks #681
@ScottHoang

Description

@ScottHoang

Hi team, I am running some eval with generate custom data locally. Is it possible to dynamically add custom tasks with a local file directory? Ideally I would like to be able to do something like:
load_datasets("parquet", data_files="path_to_my_data")
I do not believe data_files is an argument to LightevalTaskConfig ?
Thank you!

Metadata

Metadata

Assignees

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

    0