Mutli chat history #73
test-mito-ai-frontend.yml
on: pull_request
Matrix: test-mitoai-frontend-jupyterlab
Annotations
10 errors, 8 warnings, and 4 notices
[chromium] › mitoai_ui_tests/agent.spec.ts:242:9 › Stop Agent › Stop agent during error fixup:
tests/mitoai_ui_tests/agent.spec.ts#L269
1) [chromium] › mitoai_ui_tests/agent.spec.ts:242:9 › Stop Agent › Stop agent during error fixup ─
Error: Timed out 5000ms waiting for expect(locator).toBeVisible()
Locator: getByText('Agent execution stopped')
Expected: visible
Received: <element(s) not found>
Call log:
- expect.toBeVisible with timeout 5000ms
- waiting for getByText('Agent execution stopped')
267 |
268 | // Verify that the message "Agent stopped" is visible
> 269 | await expect(page.getByText('Agent execution stopped')).toBeVisible();
| ^
270 |
271 | // Verify we don't see the final error message
272 | const messages = await page.locator('.message-assistant-chat').all();
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/agent.spec.ts:269:65
|
[chromium] › mitoai_ui_tests/agent.spec.ts:242:9 › Stop Agent › Stop agent during error fixup:
tests/mitoai_ui_tests/agent.spec.ts#L257
1) [chromium] › mitoai_ui_tests/agent.spec.ts:242:9 › Stop Agent › Stop agent during error fixup ─
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Expected retry message not found
Call Log:
- Test timeout of 60000ms exceeded
255 | throw new Error('Expected retry message not found');
256 | }
> 257 | }).toPass({ timeout: 45000 });
| ^
258 |
259 | // Click the Stop Agent button
260 | await page.getByRole('button', { name: 'Stop Agent' }).click();
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/agent.spec.ts:257:12
|
[chromium] › mitoai_ui_tests/agent.spec.ts:366:9 › Agent mode blacklisted words › Blacklisted command shows error and prevents execution:
tests/mitoai_ui_tests/agent.spec.ts#L380
1) [chromium] › mitoai_ui_tests/agent.spec.ts:366:9 › Agent mode blacklisted words › Blacklisted command shows error and prevents execution
Error: Expected message not found
Call Log:
- Test timeout of 60000ms exceeded
378 | throw new Error('Expected message not found');
379 | }
> 380 | }).toPass({ timeout: 45000 }); // Increase timeout if needed
| ^
381 |
382 | // Verify that no dangerous command appears in any cell
383 | const cells = await page.locator('.jp-Cell').all();
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/agent.spec.ts:380:12
|
[chromium] › mitoai_ui_tests/agent.spec.ts:366:9 › Agent mode blacklisted words › Blacklisted command shows error and prevents execution:
tests/mitoai_ui_tests/agent.spec.ts#L380
1) [chromium] › mitoai_ui_tests/agent.spec.ts:366:9 › Agent mode blacklisted words › Blacklisted command shows error and prevents execution
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: Expected message not found
Call Log:
- Test timeout of 60000ms exceeded
378 | throw new Error('Expected message not found');
379 | }
> 380 | }).toPass({ timeout: 45000 }); // Increase timeout if needed
| ^
381 |
382 | // Verify that no dangerous command appears in any cell
383 | const cells = await page.locator('.jp-Cell').all();
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/agent.spec.ts:380:12
|
[chromium] › mitoai_ui_tests/agent.spec.ts:114:9 › Agent mode print hi › Run agent's plan:
tests/mitoai_ui_tests/agent.spec.ts#L147
1) [chromium] › mitoai_ui_tests/agent.spec.ts:114:9 › Agent mode print hi › Run agent's plan ─────
Error: expect(received).toContain(expected) // indexOf
Expected substring: "# This is a new cell created as Step 1 in the Jupyter Notebook. # You can now add your code here for further tasks."
Received string: "print('hi') # This cell is used to confirm that the output has been generated.
# Please execute the previous cell (which prints 'hi') to see the output.
# Once executed, you should see 'hi' printed below.··
# (No additional code is necessary in this cell.) "
145 | // Ensure all code snippets are in the notebook
146 | codeSnippetsFromChatMessages.forEach(codeSnippet => {
> 147 | expect(codeFromCellsString).toContain(codeSnippet.trim());
| ^
148 | });
149 | });
150 |
at forEach (/home/runner/work/mito/mito/tests/mitoai_ui_tests/agent.spec.ts:147:41)
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/agent.spec.ts:146:38
|
[chromium] › mitoai_ui_tests/agent.spec.ts:151:9 › Agent mode print hi › Run agent's plan then send a follow up chat message:
tests/mitoai_ui_tests/agent.spec.ts#L179
2) [chromium] › mitoai_ui_tests/agent.spec.ts:151:9 › Agent mode print hi › Run agent's plan then send a follow up chat message
Error: expect(received).toContain(expected) // indexOf
Expected substring: "print"
Received string: "# New cell added as per Step 1: Open a new cell
# This cell is now available for further code additions. "
177 | const cellCount = await page.locator('.jp-Cell').count();
178 | const code = await getCodeFromCell(page, cellCount - 1);
> 179 | expect(code).toContain('print');
| ^
180 | expect(code).toContain('bye');
181 | });
182 | });
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/agent.spec.ts:179:22
|
[chromium] › mitoai_ui_tests/agent.spec.ts:203:9 › Stop Agent › Stop agent's plan execution:
tests/mitoai_ui_tests/agent.spec.ts#L236
3) [chromium] › mitoai_ui_tests/agent.spec.ts:203:9 › Stop Agent › Stop agent's plan execution ───
Error: expect(received).toBeLessThan(expected)
Expected: < 3
Received: 3
234 |
235 | // Verify that not all steps were executed (there should be fewer chat messages than planned steps)
> 236 | expect(finalNumOfChatMessages - startingNumOfChatMessages).toBeLessThan(numOfStepsInAgentsPlan);
| ^
237 |
238 | // Verify that the message "Agent stopped" is visible
239 | await expect(page.getByText('Agent execution stopped')).toBeVisible();
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/agent.spec.ts:236:68
|
[chromium] › mitoai_ui_tests/mitoai.spec.ts:355:7 › Mito AI Chat › Restore message history:
tests/mitoai_ui_tests/mitoai.spec.ts#L379
4) [chromium] › mitoai_ui_tests/mitoai.spec.ts:355:7 › Mito AI Chat › Restore message history ────
Error: Timed out 5000ms waiting for expect(locator).toHaveCount(expected)
Locator: locator('.message-user')
Expected: 2
Received: 1
Call log:
- expect.toHaveCount with timeout 5000ms
- waiting for locator('.message-user')
9 × locator resolved to 1 element
- unexpected value "1"
377 | // 1 from the previous message, 1 for the new chat input since we use
378 | // the message-user class on the chat input also
> 379 | await expect(page.locator('.message-user')).toHaveCount(2);
| ^
380 | await expect(page.locator('.message-assistant-chat')).toHaveCount(1);
381 | });
382 | });
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/mitoai.spec.ts:379:49
|
[chromium] › mitoai_ui_tests/mitoai.spec.ts:355:7 › Mito AI Chat › Restore message history:
tests/mitoai_ui_tests/mitoai.spec.ts#L1
4) [chromium] › mitoai_ui_tests/mitoai.spec.ts:355:7 › Mito AI Chat › Restore message history ────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Test timeout of 60000ms exceeded.
|
[chromium] › mitoai_ui_tests/mitoai.spec.ts:355:7 › Mito AI Chat › Restore message history:
tests/mitoai_ui_tests/mitoai.spec.ts#L373
4) [chromium] › mitoai_ui_tests/mitoai.spec.ts:355:7 › Mito AI Chat › Restore message history ────
Retry #1 ───────────────────────────────────────────────────────────────────────────────────────
Error: locator.click: Test timeout of 60000ms exceeded.
Call log:
- waiting for getByRole('button', { name: 'Select Kernel' })
371 | await page.reload({waitForIsReady: false});
372 | await Promise.all([
> 373 | page.getByRole('button', { name: 'Select Kernel' }).click(),
| ^
374 | waitForIdle(page)
375 | ]);
376 |
at /home/runner/work/mito/mito/tests/mitoai_ui_tests/mitoai.spec.ts:373:59
|
test-mitoai-frontend-jupyterlab (3.12, false)
The Ubuntu-20.04 brownout takes place from 2025-02-01. For more details, see https://github.com/actions/runner-images/issues/11101
|
Playwright
You are using a frozen webkit browser which does not receive updates anymore on ubuntu20.04-x64. Please update to the latest version of your operating system to test up-to-date browsers.
|
test-mitoai-frontend-jupyterlab (3.12, true)
The Ubuntu-20.04 brownout takes place from 2025-02-01. For more details, see https://github.com/actions/runner-images/issues/11101
|
Playwright
You are using a frozen webkit browser which does not receive updates anymore on ubuntu20.04-x64. Please update to the latest version of your operating system to test up-to-date browsers.
|
test-mitoai-frontend-jupyterlab (3.10, true)
The Ubuntu-20.04 brownout takes place from 2025-02-01. For more details, see https://github.com/actions/runner-images/issues/11101
|
Playwright
You are using a frozen webkit browser which does not receive updates anymore on ubuntu20.04-x64. Please update to the latest version of your operating system to test up-to-date browsers.
|
test-mitoai-frontend-jupyterlab (3.10, false)
The Ubuntu-20.04 brownout takes place from 2025-02-01. For more details, see https://github.com/actions/runner-images/issues/11101
|
Playwright
You are using a frozen webkit browser which does not receive updates anymore on ubuntu20.04-x64. Please update to the latest version of your operating system to test up-to-date browsers.
|
🎭 Playwright Run Summary
3 skipped
40 passed (10.9m)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › mitoai_ui_tests/agent.spec.ts:242:9 › Stop Agent › Stop agent during error fixup ──
3 skipped
39 passed (13.6m)
|
🎭 Playwright Run Summary
1 flaky
[chromium] › mitoai_ui_tests/agent.spec.ts:366:9 › Agent mode blacklisted words › Blacklisted command shows error and prevents execution
3 skipped
39 passed (13.7m)
|
🎭 Playwright Run Summary
4 flaky
[chromium] › mitoai_ui_tests/agent.spec.ts:114:9 › Agent mode print hi › Run agent's plan ──────
[chromium] › mitoai_ui_tests/agent.spec.ts:151:9 › Agent mode print hi › Run agent's plan then send a follow up chat message
[chromium] › mitoai_ui_tests/agent.spec.ts:203:9 › Stop Agent › Stop agent's plan execution ────
[chromium] › mitoai_ui_tests/mitoai.spec.ts:355:7 › Mito AI Chat › Restore message history ─────
3 skipped
36 passed (14.6m)
|