Skip to content

disable local playwright tracing by default #5057

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from

Conversation

mrkishi
Copy link
Member

@mrkishi mrkishi commented May 24, 2022

This PR disables playwright tracing on local e2e tests unless process.env.TRACE is enabled. Tracing has a performance impact, so it makes sense to only trace tests when we're interested in them.

An alternative would be to enable retries locally and use trace: 'on-first-retry' instead. This would be valuable if the majority of contributors use traces as a first debugging step, otherwise requiring manual activation (ie. this pr) might be best.

Please don't delete this checklist! Before submitting the PR, please make sure you do the following:

  • It's really useful if your PR references an issue where it is discussed ahead of time. In many cases, features are absent for a reason. For large changes, please create an RFC: https://github.com/sveltejs/rfcs
  • This message body should clearly illustrate what problems it solves.
  • Ideally, include a test that fails without this PR but passes with it.

Tests

  • Run the tests with pnpm test and lint the project with pnpm lint and pnpm check

Changesets

  • If your PR makes a change that should be noted in one or more packages' changelogs, generate a changeset by running pnpm changeset and following the prompts. All changesets should be patch until SvelteKit 1.0

@changeset-bot
Copy link

changeset-bot bot commented May 24, 2022

⚠️ No Changeset found

Latest commit: 92d416a

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@dominikg
Copy link
Member

If trace on retry is used, the result archiving needs to be updated to include retried results. They are currently filtered to keep the archive smaller

- name: archive test results

@mrkishi
Copy link
Member Author

mrkishi commented May 24, 2022

This was only about local tests. Do you believe we should move CI from retain-on-failure to on-first-retry? I'm not sure it's a good deal, having tracing always enabled on CI might even surface timing-sensitive errors we miss locally due to the different execution.

@dominikg
Copy link
Member

oh, i thought you wanted to speed up CI too with the comment about on-first-retry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants