Skip to content

[Feature] oumi evaluate should save the evaluation config in the output_dir #1546

@taenin

Description

@taenin

Feature request

Currently each evaluation task saves metadata for that task in a time-stamped directory. We should also serialize and save the evaluation config as a yaml in the same location.

Motivation / references

This will help with consistency / reproducibility of results.

Simply add a line here saving the config.

Your contribution

Happy to contribute, or review a PR if anyone would like to pick this up.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions