Skip to content

Conversation

@emma-imber
Copy link
Contributor

What does this change?

Adds a 0% test to measure the impact of the Product Element on click through rate. Also makes some changes to the ab testing docs to update the example test name being used to be kebab case, to make it clearer to future users.

Why?

We want to test the impact of the Product Element on click through rate using a 'hold back' test. The audience in the control will see the Product Element as it was designed, the same as anyone not in the test. The audience in the variant will see the Product Element rendered without the additional left col or inline product cards. This is to mock a page experience very close to that of pages without the Product Element. We then want to measure the difference in click through rate between the control and variant to see if there's a measurable benefit to the new Product Element designs.

We're setting this test up as a 0% test to start so that we can check that the test data is coming through correctly.

Screenshots

Desktop

Control Variant
Screenshot 2025-11-19 at 16 24 23 Screenshot 2025-11-19 at 16 26 01

Mobile

Control Variant
Screenshot 2025-11-19 at 16 27 54 Screenshot 2025-11-19 at 16 28 32

@emma-imber emma-imber requested a review from a team as a code owner November 19, 2025 16:35
@github-actions
Copy link

Hello 👋! When you're ready to run Chromatic, please apply the run_chromatic label to this PR.

You will need to reapply the label each time you want to run Chromatic.

Click here to see the Chromatic project.

@emma-imber emma-imber added the run_chromatic Runs chromatic when label is applied label Nov 19, 2025
@github-actions github-actions bot removed the run_chromatic Runs chromatic when label is applied label Nov 19, 2025
Copy link
Contributor

@charleycampbell charleycampbell left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me! Also great updates to the docs and code comments!

@emma-imber emma-imber merged commit 77a4a14 into main Nov 20, 2025
40 checks passed
@emma-imber emma-imber deleted the ei/product-element-test branch November 20, 2025 11:27
@gu-prout
Copy link

gu-prout bot commented Nov 20, 2025

Seen on PROD (merged by @emma-imber 8 minutes and 59 seconds ago) Please check your changes!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants