Skip to content

Add test retry logic for flaky tests #8654

Closed
@mtrezza

Description

@mtrezza

New Feature / Enhancement Checklist

Current Limitation

There are still some flaky tests;

  • requires more effort to merge a PR
  • shows ci: failed labels on README

Feature / Enhancement Description

Add a test-retry logic on jasmine-level (not GitHub workflow level) specifically for flaky tests.

  1. Implement logic to retry specific tests if they fail, in the style of the existing custom test specifiers:
    global.it_exclude_dbs = excluded => {
  2. Identify flaky tests
  3. Use retry-test-specifier for flaky tests

Alternatives / Workarounds

Manually re-run tests (status quo)

References

Metadata

Metadata

Assignees

No one assigned

    Labels

    bounty:$20Bounty applies for fixing this issue (Parse Bounty Program)state:releasedReleased as stable versionstate:released-alphaReleased as alpha versionstate:released-betaReleased as beta versiontype:ciCI related issue

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions