[REGRESSION]: page.pause() does not pause test timeout after 1.47

[spiderhands]

Version

1.47.1

Steps to reproduce

1. Open any test and set await page.pause(); in it
2. Run the test in headed mode
3. Wait for the timeout duration

Expected behavior

The test execution does not stop

Actual behavior

The test execution is stopped due to the timeout with the following output:

Running 1 test using 1 worker
  1) [chromium] › example.spec.ts:5:6 › has title ──────────────────────────────────────────────────

    Test timeout of 5000ms exceeded.

  1 failed
    [chromium] › example.spec.ts:5:6 › has title ───────────────────────────────────────────────────

Additional context

Self-contained reproduction can be found in the attached archive

playwright-1.47.1-pause-debug.zip

Environment

System:
  OS: macOS 14.5
  CPU: (10) arm64 Apple M1 Pro
  Memory: 94.42 MB / 16.00 GB
Binaries:
  Node: 20.10.0 - ~/Library/pnpm/node
  npm: 10.2.3 - ~/Library/pnpm/npm
  pnpm: 9.9.0 - ~/Library/pnpm/pnpm
IDEs:
  VSCode: 1.92.2 - /usr/local/bin/code
Languages:
  Bash: 3.2.57 - /bin/bash

[mxschmitt]

Was able to reproduce, its a v1.47.0 regression.

1.47.0-alpha-2024-08-17 bad https://github.com/microsoft/playwright/tree/743565ee3e1ef47e06abd60100ec0552ba51f077
1.47.0-alpha-2024-08-15 good https://github.com/microsoft/playwright/tree/f927495791a457cabb8158dc3263e04b67936968

Diff: f927495...743565e

[dgozman]

@spiderhands Why aren't you running with --debug option? This option is supposed to update timeouts so that you can debug freely. It will also turn on headed automatically, and pause on any page.pause() calls. Let me know whether this works for you.

[spiderhands]

@dgozman, to be honest, I have not tried it till a couple of minutes ago and it does not work in our setup. We are using Playwright to test an extension and have created a custom setup to reuse the browser in a single test suite to reduce the time it takes to spin up the browser and load the extension. The loading takes about 5 seconds, so we sacrificed test isolation to increase the execution speed. We have custom handling of the headed parameter, but as we never tried the debug one I suppose it is not handled. We'll fix that on our side, but I think the page.pause() should disable timeouts anyway