Skip to content

feat: add retry strategy configuration for test retries #35766

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

dasco144
Copy link

@dasco144 dasco144 commented Apr 27, 2025

closes #23354

@dasco144 dasco144 force-pushed the dsantiago-add-retry-strategy-config branch from 58d4155 to 42cd380 Compare April 27, 2025 21:01

This comment has been minimized.

dasco144

This comment was marked as outdated.

This comment has been minimized.

Copy link
Contributor

Test results for "tests 1"

15 failed
❌ [playwright-test] › retry-strategy.spec.ts:79:5 › should run retries after all tests with trailing strategy @macos-latest-node18-1
❌ [playwright-test] › retry-strategy.spec.ts:109:5 › should run multiple retries after all tests with trailing strategy @macos-latest-node18-1
❌ [playwright-test] › retry-strategy.spec.ts:151:5 › should run serial retries after other tests with trailing strategy @macos-latest-node18-1
❌ [playwright-test] › retry-strategy.spec.ts:79:5 › should run retries after all tests with trailing strategy @ubuntu-latest-node18-1
❌ [playwright-test] › retry-strategy.spec.ts:109:5 › should run multiple retries after all tests with trailing strategy @ubuntu-latest-node18-1
❌ [playwright-test] › retry-strategy.spec.ts:151:5 › should run serial retries after other tests with trailing strategy @ubuntu-latest-node18-1
❌ [playwright-test] › retry-strategy.spec.ts:79:5 › should run retries after all tests with trailing strategy @ubuntu-latest-node20-1
❌ [playwright-test] › retry-strategy.spec.ts:109:5 › should run multiple retries after all tests with trailing strategy @ubuntu-latest-node20-1
❌ [playwright-test] › retry-strategy.spec.ts:151:5 › should run serial retries after other tests with trailing strategy @ubuntu-latest-node20-1
❌ [playwright-test] › retry-strategy.spec.ts:79:5 › should run retries after all tests with trailing strategy @ubuntu-latest-node22-1
❌ [playwright-test] › retry-strategy.spec.ts:109:5 › should run multiple retries after all tests with trailing strategy @ubuntu-latest-node22-1
❌ [playwright-test] › retry-strategy.spec.ts:151:5 › should run serial retries after other tests with trailing strategy @ubuntu-latest-node22-1
❌ [playwright-test] › retry-strategy.spec.ts:79:5 › should run retries after all tests with trailing strategy @windows-latest-node18-1
❌ [playwright-test] › retry-strategy.spec.ts:109:5 › should run multiple retries after all tests with trailing strategy @windows-latest-node18-1
❌ [playwright-test] › retry-strategy.spec.ts:151:5 › should run serial retries after other tests with trailing strategy @windows-latest-node18-1

7 flaky ⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:986:7 › cli codegen › should not throw csp directive violation errors @firefox-ubuntu-22.04-node18
⚠️ [firefox-library] › library/inspector/cli-codegen-aria.spec.ts:76:7 › should update aria snapshot highlight @firefox-ubuntu-22.04-node18
⚠️ [firefox-page] › page/page-evaluate.spec.ts:424:3 › should throw for too deep reference chain @firefox-ubuntu-22.04-node18
⚠️ [playwright-test] › ui-mode-test-ct.spec.ts:117:5 › should run component tests after editing test and component @macos-latest-node18-1
⚠️ [webkit-library] › library/video.spec.ts:441:5 › screencast › should work for popups @webkit-ubuntu-22.04-node18
⚠️ [playwright-test] › ui-mode-test-output.spec.ts:80:5 › should show console messages for test @windows-latest-node18-1
⚠️ [playwright-test] › ui-mode-test-watch.spec.ts:145:5 › should watch all @windows-latest-node18-1

39094 passed, 803 skipped
✔️✔️✔️

Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature] Flaky Tests - retry all tests at end of the test run
1 participant