-
Notifications
You must be signed in to change notification settings - Fork 10.4k
Improve flaky tests, move tests blockade. #60930
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
On each rerun different, not connected to the change tests fail azdo
I will mark them all as quarantined, otherwise there's no way to merge it. |
Don't you think it's a bit suspicious that all of these tests timed out when most or all of them do not have any recent history of flakiness? That smells of an infrastructure issue and not bad tests. |
@BrennanConroy, this is possible but then, how do I fix the infra or how do you unblock the CI in such situations so that we can be green? |
cd10c36
to
ece831a
Compare
@BrennanConroy, I changed the issues to be infra ones but edit: |
/ba-g BuildAnalysis malfunction, all the errors are already reported |
Description
EnhancedNavigationScrollBehavesSameAsBrowserOnNavigation
tests we mostly care about testing enhanced navigation, not browser navigation. The failing tests are with browser navigation, so it's fine to block only them and leave enhanced-nav based to keep running. I could not find a fix for the failing ones. Failures withSystem.Exception : Expected to use browser navigation because 'suppress-enhanced-navigation' is set to true but the element from previous path is not stale
message might depend on the timeout we use inAssertEnhancedNavigation
, so it got bumped.During the CI investigation, a few other frequent issues were found that might be fixed by changing the assert to a waiting-assert:
Contributes to #60875