Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate the cause of lengthy tests and video in E2E #8954

Open
cnotv opened this issue May 23, 2023 · 3 comments
Open

Investigate the cause of lengthy tests and video in E2E #8954

cnotv opened this issue May 23, 2023 · 3 comments
Labels
area/e2e area/test Test (e2e and unit) kind/tech-debt Technical debt QA/dev-automation Issues that engineers have written automation around so QA doesn't have look at this
Milestone

Comments

@cnotv
Copy link
Contributor

cnotv commented May 23, 2023

Description

Some tests (e.g. c1667678-cb0f-491e-b9cd-51f996550d03, 5373bf26-386f-4607-9af5-80789a08369d) seem to invest specifically an extensive amount of time without any tracked waiting from the network.
The problem seems to do not happen locally, as typical scenario opposed to reproducing E2E tests in CI.

This issue cause generation of lengthy videos which increase costs on our service.

Automation consist in reproducing the same test in a shorter time.

Screenshot 2023-05-23 at 08 27 05

@cnotv cnotv added kind/bug area/test Test (e2e and unit) QA/dev-automation Issues that engineers have written automation around so QA doesn't have look at this labels May 23, 2023
@cnotv cnotv added this to the v2.7.next3 milestone May 23, 2023
@cnotv cnotv added the area/e2e label May 23, 2023
@cnotv
Copy link
Contributor Author

cnotv commented May 25, 2023

I noticed that we are running Node 14 instead of 16, which makes everything slower.
@richard-cox could you please confirm it to me?

This is the timing in CI on push on my fork and it seems better:
https://github.com/cnotv/dashboard/actions/runs/5078845852/jobs/9123864155
As well as the report in our Cypress dashboard: bae8360287c5b153b39bb9fee92a11c8

@cnotv
Copy link
Contributor Author

cnotv commented May 25, 2023

Never mind, just a coincidence.

@nwmac nwmac added kind/tech-debt Technical debt and removed kind/bug labels Jun 8, 2023
@gaktive gaktive changed the title Investigate over the cause of lengthy tests and video in E2E Investigate the cause of lengthy tests and video in E2E Jun 8, 2023
@gaktive
Copy link
Member

gaktive commented Jun 8, 2023

Perhaps the videos can be detached from the droplet and placed into a storage bucket. They are useful for detecting regressions or changes in behaviour.

@gaktive gaktive modified the milestones: v2.7.next3, v2.8.next4 Jul 19, 2023
@gaktive gaktive modified the milestones: v2.8.0, v2.8.next1 Sep 22, 2023
@nwmac nwmac modified the milestones: v2.9.0, v2.9.x Feb 27, 2024
@gaktive gaktive modified the milestones: v2.9.x, v2.12.0 Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/e2e area/test Test (e2e and unit) kind/tech-debt Technical debt QA/dev-automation Issues that engineers have written automation around so QA doesn't have look at this
Projects
None yet
Development

No branches or pull requests

3 participants