Skip to content

Replace Sauce Labs with Playwright #117

Closed
@vweevers

Description

@vweevers

It has served us well for a long time, but I've spent more (too much) time chasing issues that arise from changes to their platform, than to changes to the code we're testing. Mostly recently (Level/abstract-level#42) tests started failing with the following error:

Misconfigured -- You've exceeded your Sauce Labs concurrency limit. This test was throttled and ultimately timed out waiting for a free slot to run. You can upgrade your account for higher-concurrency at https://saucelabs.com/pricing.

Replacing Sauce Labs will reduce our coverage of browsers by only a small percentage (in terms of how many end users we serve by testing lesser-used browsers). The benefits far outweigh that: Playwright is faster, more stable, and we (in fact anyone) can run the same suite locally and in CI (without needing credentials). It's easy to achieve as we can continue using Airtap, but with airtap-playwright instead of airtap-sauce.

Side note: for the Airtap project, it likely means airtap-sauce won't be maintained anymore, at least not by me.

Repositories that this applies to:

  • abstract-level
  • memory-level
  • browser-level
  • levelup (will be deprecated)
  • ...

Metadata

Metadata

Assignees

No one assigned

    Labels

    maintenanceGeneral maintenancepull request welcomeA pull request is welcometestImprovements or additions to tests

    Type

    No type

    Projects

    Status

    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions