Skip to content
This repository has been archived by the owner on Sep 11, 2024. It is now read-only.

End to End Tests

End to End Tests #7264

Triggered via workflow run February 6, 2024 18:04
@HarHarLinksHarHarLinks
completed a664172
Status Failure
Total duration 23m 50s
Artifacts 9

end-to-end-tests.yaml

on: workflow_run
Prepare
2s
Prepare
Matrix: tests
Report results
49s
Report results
Fit to window
Zoom out
Zoom in

Annotations

12 errors, 15 warnings, and 1 notice
Run Tests 5/8
The process '/usr/bin/xvfb-run' failed with exit code 1
Run Tests 1/8
The process '/usr/bin/xvfb-run' failed with exit code 1
[Legacy Crypto] › crypto/logout.spec.ts:67:9 › Logout tests › Ask to set up recovery on logout if not setup: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L80
1) [Legacy Crypto] › crypto/logout.spec.ts:67:9 › Logout tests › Ask to set up recovery on logout if not setup Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByRole('heading', { name: 'You\'ll lose access to your encrypted messages' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByRole('heading', { name: 'You\'ll lose access to your encrypted messages' }) 78 | await expect( 79 | currentDialogLocator.getByRole("heading", { name: "You'll lose access to your encrypted messages" }), > 80 | ).toBeVisible(); | ^ 81 | }); 82 | 83 | test("If backup is set up show standard confirm", async ({ page, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:80:11
[Legacy Crypto] › crypto/logout.spec.ts:67:9 › Logout tests › Ask to set up recovery on logout if not setup: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L80
1) [Legacy Crypto] › crypto/logout.spec.ts:67:9 › Logout tests › Ask to set up recovery on logout if not setup Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByRole('heading', { name: 'You\'ll lose access to your encrypted messages' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByRole('heading', { name: 'You\'ll lose access to your encrypted messages' }) 78 | await expect( 79 | currentDialogLocator.getByRole("heading", { name: "You'll lose access to your encrypted messages" }), > 80 | ).toBeVisible(); | ^ 81 | }); 82 | 83 | test("If backup is set up show standard confirm", async ({ page, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:80:11
[Legacy Crypto] › crypto/logout.spec.ts:67:9 › Logout tests › Ask to set up recovery on logout if not setup: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L80
1) [Legacy Crypto] › crypto/logout.spec.ts:67:9 › Logout tests › Ask to set up recovery on logout if not setup Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByRole('heading', { name: 'You\'ll lose access to your encrypted messages' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByRole('heading', { name: 'You\'ll lose access to your encrypted messages' }) 78 | await expect( 79 | currentDialogLocator.getByRole("heading", { name: "You'll lose access to your encrypted messages" }), > 80 | ).toBeVisible(); | ^ 81 | }); 82 | 83 | test("If backup is set up show standard confirm", async ({ page, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:80:11
[Legacy Crypto] › crypto/logout.spec.ts:83:9 › Logout tests › If backup is set up show standard confirm: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L96
2) [Legacy Crypto] › crypto/logout.spec.ts:83:9 › Logout tests › If backup is set up show standard confirm Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByText('Are you sure you want to sign out?') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByText('Are you sure you want to sign out?') 94 | const currentDialogLocator = page.locator(".mx_Dialog"); 95 | > 96 | await expect(currentDialogLocator.getByText("Are you sure you want to sign out?")).toBeVisible(); | ^ 97 | }); 98 | 99 | test("Logout directly if the user has no room keys", async ({ page, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:96:92
[Legacy Crypto] › crypto/logout.spec.ts:83:9 › Logout tests › If backup is set up show standard confirm: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L96
2) [Legacy Crypto] › crypto/logout.spec.ts:83:9 › Logout tests › If backup is set up show standard confirm Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByText('Are you sure you want to sign out?') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByText('Are you sure you want to sign out?') 94 | const currentDialogLocator = page.locator(".mx_Dialog"); 95 | > 96 | await expect(currentDialogLocator.getByText("Are you sure you want to sign out?")).toBeVisible(); | ^ 97 | }); 98 | 99 | test("Logout directly if the user has no room keys", async ({ page, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:96:92
[Legacy Crypto] › crypto/logout.spec.ts:83:9 › Logout tests › If backup is set up show standard confirm: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L96
2) [Legacy Crypto] › crypto/logout.spec.ts:83:9 › Logout tests › If backup is set up show standard confirm Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: locator('.mx_Dialog').getByText('Are you sure you want to sign out?') Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for locator('.mx_Dialog').getByText('Are you sure you want to sign out?') 94 | const currentDialogLocator = page.locator(".mx_Dialog"); 95 | > 96 | await expect(currentDialogLocator.getByText("Are you sure you want to sign out?")).toBeVisible(); | ^ 97 | }); 98 | 99 | test("Logout directly if the user has no room keys", async ({ page, app }) => { at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:96:92
[Legacy Crypto] › crypto/logout.spec.ts:99:9 › Logout tests › Logout directly if the user has no room keys: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L108
3) [Legacy Crypto] › crypto/logout.spec.ts:99:9 › Logout tests › Logout directly if the user has no room keys Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Sign in' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Sign in' }) 106 | 107 | // Should have logged out directly > 108 | await expect(page.getByRole("heading", { name: "Sign in" })).toBeVisible(); | ^ 109 | }); 110 | }); 111 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:108:70
[Legacy Crypto] › crypto/logout.spec.ts:99:9 › Logout tests › Logout directly if the user has no room keys: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L108
3) [Legacy Crypto] › crypto/logout.spec.ts:99:9 › Logout tests › Logout directly if the user has no room keys Retry #1 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Sign in' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Sign in' }) 106 | 107 | // Should have logged out directly > 108 | await expect(page.getByRole("heading", { name: "Sign in" })).toBeVisible(); | ^ 109 | }); 110 | }); 111 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:108:70
[Legacy Crypto] › crypto/logout.spec.ts:99:9 › Logout tests › Logout directly if the user has no room keys: matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts#L108
3) [Legacy Crypto] › crypto/logout.spec.ts:99:9 › Logout tests › Logout directly if the user has no room keys Retry #2 ─────────────────────────────────────────────────────────────────────────────────────── Error: Timed out 5000ms waiting for expect(locator).toBeVisible() Locator: getByRole('heading', { name: 'Sign in' }) Expected: visible Received: hidden Call log: - expect.toBeVisible with timeout 5000ms - waiting for getByRole('heading', { name: 'Sign in' }) 106 | 107 | // Should have logged out directly > 108 | await expect(page.getByRole("heading", { name: "Sign in" })).toBeVisible(); | ^ 109 | }); 110 | }); 111 | at /home/runner/work/matrix-react-sdk/matrix-react-sdk/matrix-react-sdk/playwright/e2e/crypto/logout.spec.ts:108:70
[Legacy Crypto] › crypto/staged-rollout.spec.ts:158:9 › Adoption of rust stack › Migrate using labflag should work: matrix-react-sdk/playwright/e2e/crypto/staged-rollout.spec.ts#L1
4) [Legacy Crypto] › crypto/staged-rollout.spec.ts:158:9 › Adoption of rust stack › Migrate using labflag should work Test timeout of 90000ms exceeded.
Prepare
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 2/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 6/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 4/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 8/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 7/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 3/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 5/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Run Tests 1/8
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: coactions/setup-xvfb@b6b4fcfb9f5a895edadc3bc76318fae0ac17c8b3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Report results
Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: Sibz/github-status-action@071b5370da85afbb16637d6eed8524a06bc2053e, bobheadxi/deployments@88ce5600046c82542f8246ac287d0a53c461bca3, actions/github-script@v6, nwtgck/actions-netlify@7a92f00dde8c92a5a9e8385ec2919775f7647352. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Slow Test: [Rust Crypto] › read-receipts/redactions.spec.ts#L1
[Rust Crypto] › read-receipts/redactions.spec.ts took 6.0m
Slow Test: [Legacy Crypto] › read-receipts/redactions.spec.ts#L1
[Legacy Crypto] › read-receipts/redactions.spec.ts took 5.5m
Slow Test: [Legacy Crypto] › crypto/staged-rollout.spec.ts#L1
[Legacy Crypto] › crypto/staged-rollout.spec.ts took 5.0m
Slow Test: [Rust Crypto] › read-receipts/new-messages.spec.ts#L1
[Rust Crypto] › read-receipts/new-messages.spec.ts took 3.8m
Slow Test: [Rust Crypto] › read-receipts/high-level.spec.ts#L1
[Rust Crypto] › read-receipts/high-level.spec.ts took 3.6m
🎭 Playwright Run Summary
11 failed [Legacy Crypto] › crypto/logout.spec.ts:67:9 › Logout tests › Ask to set up recovery on logout if not setup [Legacy Crypto] › crypto/logout.spec.ts:83:9 › Logout tests › If backup is set up show standard confirm [Legacy Crypto] › crypto/logout.spec.ts:99:9 › Logout tests › Logout directly if the user has no room keys [Legacy Crypto] › crypto/staged-rollout.spec.ts:158:9 › Adoption of rust stack › Migrate using labflag should work [Legacy Crypto] › login/login.spec.ts:107:13 › Login › logout › should go to login page on logout [Legacy Crypto] › login/login.spec.ts:132:13 › Login › logout with logout_redirect_url › should respect logout_redirect_url [Rust Crypto] › crypto/logout.spec.ts:67:9 › Logout tests › Ask to set up recovery on logout if not setup [Rust Crypto] › crypto/logout.spec.ts:83:9 › Logout tests › If backup is set up show standard confirm [Rust Crypto] › crypto/logout.spec.ts:99:9 › Logout tests › Logout directly if the user has no room keys [Rust Crypto] › login/login.spec.ts:107:13 › Login › logout › should go to login page on logout [Rust Crypto] › login/login.spec.ts:132:13 › Login › logout with logout_redirect_url › should respect logout_redirect_url 3 flaky [Legacy Crypto] › room/room.spec.ts:64:9 › Room Directory › should memorize the timeline position when switch Room A -> Room B -> Room A [Legacy Crypto] › timeline/timeline.spec.ts:910:13 › Timeline › message sending › should display a reply chain [Rust Crypto] › timeline/timeline.spec.ts:910:13 › Timeline › message sending › should display a reply chain 122 skipped 628 passed (21.7m)

Artifacts

Produced during runtime
Name Size
all-blob-reports-1 Expired
55.2 MB
all-blob-reports-2 Expired
612 KB
all-blob-reports-3 Expired
6.06 MB
all-blob-reports-4 Expired
4.64 MB
all-blob-reports-5 Expired
46.9 MB
all-blob-reports-6 Expired
590 KB
all-blob-reports-7 Expired
913 KB
all-blob-reports-8 Expired
4.78 MB
html-report--attempt-1 Expired
115 MB