Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Basic end-to-end test framework #7

Open
auhlig opened this issue Mar 11, 2024 · 3 comments
Open

Basic end-to-end test framework #7

auhlig opened this issue Mar 11, 2024 · 3 comments
Assignees
Labels
Milestone

Comments

@auhlig
Copy link
Member

auhlig commented Mar 11, 2024

Umbrella issue for tracking e2e test framework efforts.
Granular sub-issues can be found via label WP2.3.4.6 End-to-end test framwork.

Greenhouse should have an e2e test framework to ensure the stability and reliability of our platform.

  1. Define test framework feat(test): creating local cluster for e2e  #250 Feat(e2e): test setup #276
  2. Define test scenarios End-to-end test scenarios #12 [FEAT] - E2E Plugin Lifecycle #419
  3. Define test setup. Should run locally + in PR as well.
  4. Define integration in CI [FEAT] - E2E Workflow #467
  5. Documentation

Acceptance criteria:

  • E2E tests are implemented and cover the identified critical scenarios.
  • E2E tests run successfully on the CI/CD pipeline.
  • Documentation for running E2E tests is provided.
  • Metrics, alerts and visualization integration. Showcasing stability + trend
@uwe-mayer
Copy link
Contributor

Define test scenarios here: #12

@uwe-mayer
Copy link
Contributor

Update:

  • We can direct e2e tests to be executed against remote greenhouse clusters with minor changes to our existing test setup and by using the USE_EXISTING_CLUSTER
  • We need a way to start up a local kind cluster with a greenhouse installation. Preferably from go code, so we do not have dependency to kind on the host. But that is still up for discussion. In the end we would like to have a Make target e.g. make e2e-local that spins up the greenhouse kind cluster and points the e2e setup to execute against it, by simply exposing a KUBECONFIG env var.

@IvoGoman IvoGoman added the backlog Issues that are part of the backlog label Apr 26, 2024
@auhlig
Copy link
Member Author

auhlig commented May 16, 2024

see #211

@auhlig auhlig modified the milestones: Q1/2024, Q2/2024 May 22, 2024
@auhlig auhlig added the jira label Jul 31, 2024
@github-actions github-actions bot added OWS2-218 and removed jira labels Jul 31, 2024
@auhlig auhlig modified the milestones: Q2/2024, Q3/2024, Q4 /2024 Aug 1, 2024
@auhlig auhlig changed the title End-to-end test framework Basic end-to-end test framework Aug 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: In progress
Status: In Progress
Development

No branches or pull requests

4 participants