[Question] Github Actions test compatibility check failed mitigation?

[hongkiulam]

I have "@playwright/test: "^1.26.1", defined in my package json and the following in my GHA

    steps:
      - name: ⬇️ Checkout repo
        uses: actions/checkout@v2

      - name: 📦 Install pnpm
        uses: pnpm/action-setup@v2.2.2
        with:
          version: 7

      - name: 📦 Setup Node
        uses: actions/setup-node@v3
        with:
          node-version: 16.x
          cache: "pnpm"

      - name: ⏬ Install Dependencies
        run: pnpm install

      - name: 🌐 Install Playwright Browsers
        run: pnpx playwright install --with-deps

      - name: Test
        run: pnpm test

But I get this error when installing the browsers

╔══════════════════════════════════════════════════════════════════════════════════════════════════════════╗
║ Playwright Test compatibility check failed:                                                              ║
║ @playwright/test version '1.26.1' does not match playwright version '1.27.0'!                            ║

I was hoping that by running pnpx playwright it would run the install deps with playwright cli v1.26.1, but even so it downloads v1.27.1 browsers?
Is there any alternative to simple updating the version in package*.json because I imagine this could continue happening and it would be quite annoying to always have to go back and update the version after it fails in CI

[hongkiulam]

@pavelfeldman I didn't have playwright or playwright/core in my package.json

{
  "name": "home-fe",
  "version": "0.1.0",
  "private": true,
  "scripts": {
    "dev": "next dev --port 3001",
    "test:local": "playwright test --config ./tests/playwright.local.config.ts",
    "test:host": "playwright test --config ./tests/playwright.host.config.ts"
  },
  "dependencies": {
    "next": "12.3.1",
    "react": "18.2.0",
    "react-dom": "18.2.0"
  },
  "devDependencies": {
    "@module-federation/nextjs-mf": "^5.5.1",
    "@playwright/test": "^1.27.0",
    "@types/node": "18.7.23",
    "@types/react": "18.0.21",
    "@types/react-dom": "18.0.6",
    "@typescript-eslint/eslint-plugin": "^5.38.1",
    "@typescript-eslint/parser": "^5.38.1",
    "eslint": "^8.2.0",
    "prettier": "^2.7.1",
    "typescript": "4.8.3"
  },
  "engines": {
    "npm": "please-use-pnpm",
    "yarn": "please-use-pnpm"
  }
}

I managed to fix the issue by updating @playwright/test to 1.27.0 though

[hongkiulam]

Seems like the issue is related to the use of pnpm and the pnpx command, after changing to use npx it no longer throws the error

pnpx playwright install --with-deps < throws error

npx playwright install --with-deps < works fine

[zkochan]

pnpx playwright install --with-deps will install the playwright package and execute it. What you want to do is execute the bin file from node_modules/.bin called playwright. For that pnpm has a different command: pnpm exec (or just pnpm).

So you can run one of:

pnpm exec playwright install --with-deps

or

pnpm playwright install --with-deps

[octref]

@zkochan I'm wondering why pnpx or dlx uses the globally installed version when a local dep is installed. I'm fixing my GitHub CI and the other issue suggests replacing dlx with exec as well: #19562
Is that the intended behavior or should I open a new issue in pnpm repo?

npx x uses the local package if you are in the project where x is installed as a (dev)dependency. For example see https://medium.com/@maybekatz/introducing-npx-an-npm-package-runner-55f7d4bd282b