Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

✅ Remove skipWindows() as a test config #24143

Merged
merged 1 commit into from
Aug 22, 2019

Conversation

estherkim
Copy link
Collaborator

@estherkim estherkim commented Aug 22, 2019

skipWindows() was used to skip flaky tests, but introduced a side effect where tests were being skipped for all browsers (excluding those opted into Safari) in Sauce Labs. This is because we run integration tests for Chrome, Firefox, Edge and IE on Windows.

Skipping tests should be allowed at the browser level, not OS.

related to #24124

@estherkim
Copy link
Collaborator Author

Looks like this adds 76 tests back to SauceLabs

Copy link
Contributor

@rsimha rsimha left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice catch. Are there any cases where a test legitimately targets Linux / Mac OS and cannot run on Windows?

@estherkim
Copy link
Collaborator Author

Tests can opt into Safari, nothing for Linux.

@estherkim estherkim merged commit ac980e9 into ampproject:master Aug 22, 2019
@estherkim estherkim deleted the remove-skip-windows branch August 22, 2019 17:45
thekorn pushed a commit to edelight/amphtml that referenced this pull request Sep 11, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants