Skip to content

Non deterministic test output leads to flaky CI Jobs #98

@Munsio

Description

@Munsio

It seems that with #94 we introduced some non-determinism into the tests for CSV output.
https://github.com/symflower/eval-dev-quality/actions/runs/8987716044/job/24686885243#logs

Tasks:

  • Sort the models before writing the CSV output

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions