1) pinned-messages/pinned-messages.spec.ts:104:9 › Pinned messages › should display 4 messages in the banner Error: Screenshot comparison failed: 532 pixels (ratio 0.01 of all image pixels) are different. Expected: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/snapshots/pinned-messages/pinned-messages.spec.ts/pinned-message-banner-4-Msg4-linux.png Received: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner/pinned-message-banner-4-Msg4-actual.png Diff: /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/test-results/pinned-messages-pinned-mes-6cce3-ay-4-messages-in-the-banner/pinned-message-banner-4-Msg4-diff.png Call log: - expect.toHaveScreenshot(pinned-message-banner-4-Msg4.png) with timeout 5000ms - verifying given screenshot expectation - waiting for getByTestId('pinned-message-banner') - locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - 532 pixels (ratio 0.01 of all image pixels) are different. - waiting 100ms before taking screenshot - waiting for getByTestId('pinned-message-banner') - locator resolved to <div data-single-message="false" class="mx_PinnedMessageBanner" data-testid="pinned-message-banner" aria-label="This room has pinned messages. Click to view them.">…</div> - taking element screenshot - disabled all CSS animations - waiting for fonts to load... - fonts loaded - attempting scroll into view action - waiting for element to be stable - captured a stable screenshot - 532 pixels (ratio 0.01 of all image pixels) are different. 109 | for (const msg of ["Msg4", "Msg3", "Msg2", "Msg1"]) { 110 | await util.assertMessageInBanner(msg); > 111 | await expect(util.getBanner()).toMatchScreenshot(`pinned-message-banner-4-${msg}.png`); | ^ 112 | await util.getBanner().click(); 113 | } 114 | }); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/pinned-messages/pinned-messages.spec.ts:111:44

1) crypto/crypto.spec.ts:92:17 › Cryptography › setting up secure key backup should work isDeviceVerified=false › by recovery code Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') Expected: visible Received: <element(s) not found> Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_InteractiveAuthDialog .mx_Dialog_title').getByText('Setting up keys') 113 | if (!isDeviceVerified) { 114 | const uiaDialogTitle = page.locator(".mx_InteractiveAuthDialog .mx_Dialog_title"); > 115 | await expect(uiaDialogTitle.getByText("Setting up keys")).toBeVisible(); | ^ 116 | await expect(uiaDialogTitle.getByText("Setting up keys")).not.toBeVisible(); 117 | } 118 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/crypto.spec.ts:115:79

2) crypto/decryption-failure-messages.spec.ts:31:13 › Cryptography › decryption failure messages › should handle device-relative historical messages Test timeout of 60000ms exceeded.

2) crypto/decryption-failure-messages.spec.ts:31:13 › Cryptography › decryption failure messages › should handle device-relative historical messages Error: locator.click: Test timeout of 60000ms exceeded. Call log: - waiting for locator('.mx_AuthPage').getByRole('button', { name: 'Skip verification for now' }) 64 | await logOutOfElement(page); 65 | await logIntoElement(page, homeserver, credentials); > 66 | await page.locator(".mx_AuthPage").getByRole("button", { name: "Skip verification for now" }).click(); | ^ 67 | await page.locator(".mx_AuthPage").getByRole("button", { name: "I'll verify later" }).click(); 68 | await app.viewRoomByName("Test room"); 69 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/decryption-failure-messages.spec.ts:66:107

3) crypto/event-shields.spec.ts:266:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted Error: Timed out 5000ms waiting for expect(locator).not.toBeVisible() Locator: locator('.mx_EventTile').filter({ hasText: 'test encrypted from verified' }).locator('.mx_EventTile_e2eIcon') Expected: not visible Received: visible Call log: - expect.not.toBeVisible with timeout 5000ms - waiting for locator('.mx_EventTile').filter({ hasText: 'test encrypted from verified' }).locator('.mx_EventTile_e2eIcon') - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" - locator resolved to <div tabindex="0" class="mx_EventTile_e2eIcon mx_EventTile_e2eIcon_warning"></div> - unexpected value "visible" 297 | 298 | const penultimate = page.locator(".mx_EventTile").filter({ hasText: "test encrypted from verified" }); > 299 | await expect(penultimate.locator(".mx_EventTile_e2eIcon")).not.toBeVisible(); | ^ 300 | }); 301 | }); 302 | }); at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/event-shields.spec.ts:299:76

3) crypto/event-shields.spec.ts:266:13 › Cryptography › event shields › should show correct shields on events sent by devices which have since been deleted Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toContainText(expected) Locator: locator('.mx_EventTile_last') Expected string: "test encrypted from unverified" Received string: "A16:48Alice invited Bob" Call log: - expect.toContainText with timeout 5000ms - waiting for locator('.mx_EventTile_last') - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" data-scroll-tokens="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A16:48Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" data-scroll-tokens="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A16:48Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" data-scroll-tokens="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A16:48Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" data-scroll-tokens="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A16:48Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" data-scroll-tokens="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A16:48Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" data-scroll-tokens="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A16:48Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" data-scroll-tokens="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A16:48Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" data-scroll-tokens="$0cluIErnc-Zce7pLAlZp3cl1sQes5GEUpXGVoSA4jhw" class="mx_EventTile mx_EventTile_info mx_EventTile_last mx_EventTile_lastInSection">…</li> - unexpected value "A16:48Alice invited Bob" - locator resolved to <li tabindex="-1" aria-live="off" data-self="true" aria-atomic="true" data-layout="group" data-has-reply="false" data-event-id="$0cluIErnc-Zce7pLAlZp3cl1sQ

matrix-react-sdk/read-receipts/high-level.spec.ts took 3.2m

matrix-react-sdk/read-receipts/new-messages-in-threads.spec.ts took 1.6m

matrix-react-sdk/read-receipts/editing-messages-in-threads.spec.ts took 1.2m

matrix-react-sdk/read-receipts/new-messages-main-timeline.spec.ts took 1.1m

matrix-react-sdk/read-receipts/editing-messages-main-timeline.spec.ts took 1.1m

matrix-react-sdk/spaces/spaces.spec.ts took 1.1m

matrix-react-sdk/right-panel/right-panel.spec.ts took 59.3s

matrix-react-sdk/right-panel/file-panel.spec.ts took 41.6s

matrix-react-sdk/settings/account-user-settings-tab.spec.ts took 41.3s

matrix-react-sdk/settings/appearance-user-settings-tab/theme-choice-panel.spec.ts took 34.6s

matrix-react-sdk/timeline/timeline.spec.ts took 2.9m

matrix-react-sdk/spotlight/spotlight.spec.ts took 2.1m

matrix-react-sdk/spaces/threads-activity-centre/threadsActivityCentre.spec.ts took 1.8m

matrix-react-sdk/threads/threads.spec.ts took 37.3s

matrix-react-sdk/user-onboarding/user-onboarding-new.spec.ts took 33.0s

matrix-react-sdk/read-receipts/redactions-in-threads.spec.ts took 2.7m

matrix-react-sdk/read-receipts/redactions-main-timeline.spec.ts took 2.1m

matrix-react-sdk/read-receipts/read-receipts.spec.ts took 1.2m

matrix-react-sdk/read-receipts/reactions-in-threads.spec.ts took 1.1m

matrix-react-sdk/read-receipts/redactions-thread-roots.spec.ts took 56.8s

matrix-react-sdk/messages/messages.spec.ts took 2.4m

matrix-react-sdk/login/login.spec.ts took 42.3s

matrix-react-sdk/knock/knock-into-room.spec.ts took 40.4s

matrix-react-sdk/integration-manager/read_events.spec.ts took 38.2s

matrix-react-sdk/polls/polls.spec.ts took 35.8s

matrix-react-sdk/audio-player/audio-player.spec.ts took 1.3m

matrix-react-sdk/composer/RTE.spec.ts took 1.2m

matrix-react-sdk/crypto/device-verification.spec.ts took 50.1s

matrix-react-sdk/integration-manager/kick.spec.ts took 42.0s

matrix-react-sdk/editing/editing.spec.ts took 35.2s

32 skipped 50 passed (9.2m)

9 skipped 64 passed (9.2m)

4 skipped 67 passed (10.0m)

15 skipped 60 passed (10.3m)

1 flaky pinned-messages/pinned-messages.spec.ts:104:9 › Pinned messages › should display 4 messages in the banner 1 skipped 73 passed (10.8m)