-
Notifications
You must be signed in to change notification settings - Fork 6.8k
build: attempt to de-flake harness integration test #25241
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
ad3d8e8
to
132cb1d
Compare
@devversion I'm not sure what is going on with the integration test error, but it seems like a Bazel issue. My guess is that something was depending transitively on |
132cb1d
to
76163bb
Compare
I ended up switching the test to I also debugged it a bit further and it's probably not a Bazel issue, because the same error happened when I install the dependencies manually and run the test script. |
Oh yeah, that's one of the v13 APF ESM effects. e.g. Angular core imports from rxjs/operators, but rxjs does not have package exports and in ESM a directory cannot be directly imported unless there is an export mapping for it. We saw that in v13 but it wasn't a concern because we bundle tests, and the app with the Angular CLI. I believe long term we need to make sure RxJS has the proper export mappings. The v7 exports always use CommonJS for "node" (which seems incorrect) but maybe updating already helps? (In the integration test) |
I'd rather not depend on a different rxjs version from the rest of the project so it may be simplest to test using the selection list instead of the radio button. |
Ah yes. The PR still was stuck on the failing state for me so I thought you looked for a solution. Selection sounds good to me. Although it would be nice to verify that users have a way to get this working with selenium-webdriver tests that do not seem to be bundled in the CLI? It's our responsibility because we ship APF ESM packages intended for use in the NodeJS runtime |
22b7bf6
to
818b180
Compare
I pushed a change to switch back to the radio test and bump up the rxjs version, but it breaks with the same error. |
@crisbeto Ahh, I believe it might be due to:
Potentially using https://github.com/bazelbuild/bazel-skylib/blob/main/docs/dicts_doc.md#dictsomit. The bad part is that rxjs is the value not a key. The key for rxjs is determined in "tools/integration.bzl". |
818b180
to
1936ed7
Compare
Just gave it a shot, but it didn't work. |
thanks for giving it a shot. I'm happy to investigate this in my end if you feel like it. currently it does not work because the key label is different. see: components/tools/integration.bzl Line 6 in b5c935a
Maybe make that function public and use it here? (don't forget to add the @npm prefix like in the mappings dict we create) |
1936ed7
to
c7427d7
Compare
Tries to de-flake the harness e2e integration test by swapping out `mat-select` with `mat-radio-group`. `mat-select` has been causing flakes in its own Firefox tests too so it's possible that it may be the reason for the integration test flakes as well. The component being tested doesn't really matter since the integration test is primarily verifying our npm packages.
c7427d7
to
6cd2522
Compare
Okay, there we go. I was looking at the |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
Tries to de-flake the harness e2e integration test by swapping out `mat-select` with `mat-radio-group`. `mat-select` has been causing flakes in its own Firefox tests too so it's possible that it may be the reason for the integration test flakes as well. The component being tested doesn't really matter since the integration test is primarily verifying our npm packages. (cherry picked from commit a26b192)
Tries to de-flake the harness e2e integration test by swapping out `mat-select` with `mat-radio-group`. `mat-select` has been causing flakes in its own Firefox tests too so it's possible that it may be the reason for the integration test flakes as well. The component being tested doesn't really matter since the integration test is primarily verifying our npm packages. (cherry picked from commit a26b192)
This issue has been automatically locked due to inactivity. Read more about our automatic conversation locking policy. This action has been performed automatically by a bot. |
Tries to de-flake the harness e2e integration test by swapping out
mat-select
withmat-selection-list
.mat-select
has been causing flakes in its own Firefox tests too so it's possible that it may be the reason for the integration test flakes as well.The component being tested doesn't really matter since the integration test is primarily verifying our npm packages.