Skip to content
This repository was archived by the owner on Nov 16, 2023. It is now read-only.
This repository was archived by the owner on Nov 16, 2023. It is now read-only.

Generated data splits should be tracked along with model outputs, and not stored with data. #286

Open

Description

When running the prepare_dutchf3.py script, the results should be stored, and tracked, along with the outputs of each model run (logs, snapshots, configs, etc), and not separately. This means the code should run as part of the data prep in the training scripts, and not once. We should also make sure that all the required parameters (e.g. stride, or section_stride) are stored in the config files.

Otherwise, newer model runs might use older data splits, and there is no way to track which data split was used with a model.

  • Note: This also requires changes to the Docker implementation, and to the README file.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type: EnhancementThis an enhancement to an existing feature

    Type

    No type

    Projects

    No projects

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions