Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Framework: return storedVariation if we have one #6904

Merged
merged 1 commit into from
Jul 19, 2016

Conversation

rralian
Copy link
Contributor

@rralian rralian commented Jul 19, 2016

I'd like to propose that we honor any stored variation if/when we have one for tests that have not yet started. This makes it much easier to test the different variations by using the bug badge abtest helper to manually set variations.

bugbadge helper

So now for a test that has not yet started, we will return any value currently stored in localStorage first, and if we don't have one, we will return the default variation.

Testing

Make sure this doesn't destroy all things. Maybe try a known test and make sure it still works as expected. But mostly think through the change to see if you can think of any reason we wouldn't want to do this.

/cc @retrofox @apeatling @dmsnell

Test live: https://calypso.live/?branch=update/abtest-allow-savedvariation-preview

@rralian rralian added Framework [Status] Needs Review The PR is ready for review. This also triggers e2e canary tests and wp-desktop tests automatically. labels Jul 19, 2016
@rralian rralian added this to the Plans: Maintenance milestone Jul 19, 2016
@rralian rralian self-assigned this Jul 19, 2016
@apeatling
Copy link
Member

Tested and don't see anything out of whack with my default variation. I don't see any other tests that affect the plans page so I can't say if they are affected.

@rralian rralian added [Status] Ready to Merge and removed [Status] Needs Review The PR is ready for review. This also triggers e2e canary tests and wp-desktop tests automatically. labels Jul 19, 2016
@rralian rralian merged commit 02e50a6 into master Jul 19, 2016
@rralian rralian deleted the update/abtest-allow-savedvariation-preview branch July 19, 2016 20:34
@dmsnell
Copy link
Member

dmsnell commented Jul 19, 2016

Looks good to me as well

@mattm
Copy link
Contributor

mattm commented Jul 20, 2016

Great idea - looks good.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants