Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tag a subset of Playwright tests for running against live environments immediately after deployments to verify the deployment #4706

Open
sarayourfriend opened this issue Aug 2, 2024 · 0 comments
Labels
💻 aspect: code Concerns the software code in the repository 🌟 goal: addition Addition of new feature 🟨 priority: medium Not blocking but should be addressed soon 🧱 stack: frontend Related to the Nuxt frontend 🧱 stack: mgmt Related to repo management and automations

Comments

@sarayourfriend
Copy link
Contributor

Problem

We do not have any automated verification of live environment functionality after deploying them. We take for granted that things like configuration issues and such will cause problems sufficiently bad to surface in other ways (health checks, alarms, etc). That isn't necessarily the case though (#4703).

Description

Identify a subset of our Playwright tests that can be used against live environments to verify core workflows like, SSR search, CSR search, page metadata (head), and so forth.

These can be part of the regular suite, but focusable as a group (without needing to be in the same module) by a new tag on those tests, @deployment-smoketest.

We need to add a new dispatchable workflow to this repository to run these tests against an input that specifies staging or production. That new workflow should be dispatched at the end of the deployment workflows in the infrastructure repository, and the result should be reported to Slack.

Additional context

One idea coming out of the incident related to #4703 discussed by @zackkrida and me.

@sarayourfriend sarayourfriend added 🟨 priority: medium Not blocking but should be addressed soon 🌟 goal: addition Addition of new feature 💻 aspect: code Concerns the software code in the repository 🧱 stack: frontend Related to the Nuxt frontend 🧱 stack: mgmt Related to repo management and automations labels Aug 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💻 aspect: code Concerns the software code in the repository 🌟 goal: addition Addition of new feature 🟨 priority: medium Not blocking but should be addressed soon 🧱 stack: frontend Related to the Nuxt frontend 🧱 stack: mgmt Related to repo management and automations
Projects
Status: 📋 Backlog
Development

No branches or pull requests

1 participant