test: Check the webhook event tab and your funtionalities #12433
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![gitstart-app[bot]](https://avatars.githubusercontent.com/in/46283?s=60&v=4){kind=small}
|
This PR is estimated to cost between 10 and 20 credits. |
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
5 Ignored Deployments
|
|
Thank you for following the naming conventions! 🙏 Feel free to join our discord and post your PR link. |
📦 Next.js Bundle Analysis for @calcom/webThis analysis was generated by the Next.js Bundle Analysis action. 🤖 This PR introduced no changes to the JavaScript bundle! 🙌 |
Current Playwright Test Results Summary✅ 415 Passing - Run may still be in progress, this comment will be updated as current testing workflow or job completes... (Last updated on 01/23/2024 03:36:50am UTC) Run DetailsRunning Workflow PR Update on Github Actions Commit: d320ce3 Started: 01/23/2024 03:28:24am UTC
|
|
|
2 Test Cases Affected |
Test Case Results
| Test Case | Last 7 days Failures | Last 7 days Flakes |
|---|---|---|
|
Booking With Checkbox Group Question and Each Other Question Booking With Checkbox Group Question and Address Question Checkbox Group required and Address required
Retry 2 • Retry 1 • Initial Attempt |
0% (0)0 / 288 runsfailed over last 7 days |
1.74% (5)5 / 288 runsflaked over last 7 days |
|
Booking With Checkbox Group Question and Each Other Question Booking With Checkbox Group Question and Address Question Booking With Checkbox Group Question and Multi email Question Checkbox Group required and Multi email required
Retry 1 • Initial Attempt |
0% (0)0 / 266 runsfailed over last 7 days |
2.26% (6)6 / 266 runsflaked over last 7 days |
📄 apps/web/playwright/login.e2e.ts • 1 Flake
Test Case Results
| Test Case | Last 7 days Failures | Last 7 days Flakes |
|---|---|---|
|
user can login & logout succesfully -- future login flow user & logout using dashboard
Retry 1 • Initial Attempt |
35.38% (23)23 / 65 runsfailed over last 7 days |
38.46% (25)25 / 65 runsflaked over last 7 days |
📄 apps/web/playwright/booking/phoneQuestion.e2e.ts • 1 Flake
Test Case Results
| Test Case | Last 7 days Failures | Last 7 days Flakes |
|---|---|---|
|
Booking With Phone Question and Each Other Question Booking With Phone Question and Address Question Booking With Phone Question and Number Question Phone and Number required
Retry 1 • Initial Attempt |
0.30% (1)1 / 334 runfailed over last 7 days |
2.99% (10)10 / 334 runsflaked over last 7 days |
📄 apps/web/playwright/booking/addressQuestione2e/addressQuestion.e2e.ts • 1 Flake
Test Case Results
| Test Case | Last 7 days Failures | Last 7 days Flakes |
|---|---|---|
|
Booking With Address Question and Each Other Question Booking With Address Question and Multi email Question Address and Multi email not required
Retry 1 • Initial Attempt |
1.25% (4)4 / 320 runsfailed over last 7 days |
2.19% (7)7 / 320 runsflaked over last 7 days |
📄 apps/web/playwright/embed-code-generator.e2e.ts • 1 Flake
Test Case Results
| Test Case | Last 7 days Failures | Last 7 days Flakes |
|---|---|---|
|
Embed Code Generator Tests Non-Organization Event Types Page open Embed Dialog and choose floating-popup for First Event Type
Retry 1 • Initial Attempt |
0% (0)0 / 351 runsfailed over last 7 days |
12.54% (44)44 / 351 runsflaked over last 7 days |
📄 packages/embeds/embed-core/playwright/tests/action-based.e2e.ts • 8 Flakes
Top 1 Common Error Messages
|
|
8 Test Cases Affected |
Test Case Results
| Test Case | Last 7 days Failures | Last 7 days Flakes |
|---|---|---|
|
Popup Tests should open embed iframe on click - Configured with light theme
Retry 1 • Initial Attempt |
1.42% (5)5 / 351 runsfailed over last 7 days |
55.84% (196)196 / 351 runsflaked over last 7 days |
|
Popup Tests should be able to reschedule
Retry 1 • Initial Attempt |
-59.81% (-125)-125 / 209 runsfailed over last 7 days |
106.70% (223)223 / 209 runsflaked over last 7 days |
|
Popup Tests should open Routing Forms embed on click
Retry 1 • Initial Attempt |
-66.18% (-137)-137 / 207 runsfailed over last 7 days |
85.02% (176)176 / 207 runsflaked over last 7 days |
|
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe according to system theme when no theme is configured through Embed API
Retry 1 • Initial Attempt |
-65.22% (-135)-135 / 207 runsfailed over last 7 days |
101.93% (211)211 / 207 runsflaked over last 7 days |
|
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe(Booker Profile Page) with dark theme when configured with dark theme using Embed API
Retry 1 • Initial Attempt |
-65.70% (-136)-136 / 207 runsfailed over last 7 days |
65.70% (136)136 / 207 runsflaked over last 7 days |
|
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe according to system theme when configured with 'auto' theme using Embed API
Retry 1 • Initial Attempt |
-65.70% (-136)-136 / 207 runsfailed over last 7 days |
65.70% (136)136 / 207 runsflaked over last 7 days |
|
Popup Tests Floating Button Popup Pro User - Configured in App with default setting of system theme should open embed iframe(Event Booking Page) with dark theme when configured with dark theme using Embed API
Retry 1 • Initial Attempt |
-65.70% (-136)-136 / 207 runsfailed over last 7 days |
65.70% (136)136 / 207 runsflaked over last 7 days |
|
Popup Tests prendered embed should be loaded and apply the config given to it
Retry 1 • Initial Attempt |
-66.02% (-136)-136 / 206 runsfailed over last 7 days |
66.02% (136)136 / 206 runsflaked over last 7 days |
📄 packages/embeds/embed-core/playwright/tests/inline.e2e.ts • 1 Flake
Test Case Results
| Test Case | Last 7 days Failures | Last 7 days Flakes |
|---|---|---|
|
Inline Iframe Inline Iframe - Configured with Dark Theme
Retry 1 • Initial Attempt |
0.86% (3)3 / 347 runsfailed over last 7 days |
39.19% (136)136 / 347 runsflaked over last 7 days |
📄 apps/web/playwright/booking/multipleEmailQuestion.e2e.ts • 1 Flake
Test Case Results
| Test Case | Last 7 days Failures | Last 7 days Flakes |
|---|---|---|
|
Booking With Multiple Email Question and Each Other Question Booking With Multiple Email Question and checkbox group Question Multiple Email and checkbox group not required
Retry 1 • Initial Attempt |
1.99% (7)7 / 351 runsfailed over last 7 days |
4.56% (16)16 / 351 runsflaked over last 7 days |
PeerRich
added
Low priority
|
On this PR we are performing the following steps:
|
|
This PR is being marked as stale due to inactivity. |
| @@ -0,0 +1,233 @@ | |||
| import { expect } from "@playwright/test"; | |||
There was a problem hiding this comment.
I feel like webhook.e2e.ts is the right place for these tests. That file verifies settings webhooks flow and it verifies the event-type webhook flow.
We will have a single place for all types of webhook tests.
They share a lot of logic as well.
| webhookReceiver.close(); | ||
| }); | ||
|
|
||
| test("Booking canceled", async ({ bookingPage }) => { |
There was a problem hiding this comment.
Suggested change
| test("Booking canceled", async ({ bookingPage }) => { | |
| test("Booking cancelled", async ({ bookingPage }) => { |
hariombalhara
previously requested changes
Jan 20, 2024
|
This PR is estimated to cost between 10 and 20 credits. |
|
@gitstart-calcom i see the tests are passing now. Is this ready to be pulled out of draft? |
|
Hi @keithwillcode , it's ready for review! Thanks for the reminder 😄 |
keithwillcode
approved these changes
Jan 25, 2024
Udit-takkar
added a commit
that referenced
this pull request
Feb 28, 2024
* fix: Test flakiness due to unfilled name/email * Better toast-success checks * Revert "test: Create E2E tests for bookings with custom/required Phone + other questions (#11502)" This reverts commit 614741d. * Revert "test: Create E2E tests for bookings with custom/required Multiple Emails + other questions (teste2e-multipleEmailQuestion) (#11565)" This reverts commit d1d50b0. * Revert "test: Create E2E tests for bookings with custom/required Long Text + other questions (teste2e-longTextQuestion) (#11559)" This reverts commit 96810b5. * Revert "test: Check the webhook event tab and your funtionalities (#12433)" This reverts commit 9db9204. * Re-instate regularBookings * Fixtures used by other tests * Removed dead code from regularBookings.ts --------- Co-authored-by: Udit Takkar <53316345+Udit-takkar@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
DEMO
Fixes #13180