Skip to content

Build test suite to detect changes that break loading of models #458

Open
@vpratz

Description

@vpratz

To avoid accidentally breaking serialization/model loading, we need an automated testing framework. It should store checkpoints and outputs produced with one version, and load the checkpoints and compare the outputs in a different version.

For maximum flexibility, it would probably best if we could run it on arbitrary git refs, to allow tracing down potential breakages and checking it locally during development.

This will be a larger undertaking, but should have priority for version 2.1 so that we can make serialization more stable.

Metadata

Metadata

Assignees

Labels

unit testsA new set of tests needs to be added.

Type

Projects

Status

Todo

Relationships

None yet

Development

No branches or pull requests

Issue actions