Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Charts[Test]: Implement smoke tests and integrate with CI/CD #338

Open
7 tasks
Tracked by #111
leninmehedy opened this issue Sep 13, 2023 · 2 comments
Open
7 tasks
Tracked by #111

Charts[Test]: Implement smoke tests and integrate with CI/CD #338

leninmehedy opened this issue Sep 13, 2023 · 2 comments
Labels
Epic Lv2 A body of work that can be broken down into specific tasks. Pending Triage New issue that needs to be triaged by the team

Comments

@leninmehedy
Copy link
Member

leninmehedy commented Sep 13, 2023

Requested Feature

We need a set of smoke tests to be run after the infrastructure is deployed to ensure port mappings are correct.

There are few manual smoke test scripts available that we run manually to ensure the infrastructure is operational. So it would be useful to have those automated as a separate Makefile target.

Some of the existing "manual smoke tests" are in the following directories:

  • /dev/gateway-api
  • /dev/telemetry

We could have a makefile target such as "make run-smoke-tests" that runs those smoke tests. This should also be run in the CI pipeline.

Business Need

Currently helm-chart tests only verifies if infrastructure components have been deployed or not. Smoke tests for port mapping can add extra confidence that the infrastructure is operational by running some basic e2e that tests for telemetry and gateway-api.

In addition, these sets of basic smoke tests should be run in CI-pipeline.

Additional Context

We could have these tests as part of the fsnetman CLI

Tasks

Preview Give feedback
  1. Feature Enhancement Pending Triage
  2. Pending Triage
  3. Pending Triage
  4. Pending Triage
  5. Pending Triage
  6. Pending Triage
@leninmehedy leninmehedy added New Feature A new feature, service, or documentation. Major changes that are not backwards compatible. Pending Triage New issue that needs to be triaged by the team labels Sep 13, 2023
@leninmehedy leninmehedy self-assigned this Sep 13, 2023
@leninmehedy leninmehedy moved this to 🔖 Ready in FST Suite Sep 13, 2023
@nathanklick nathanklick added this to the v0.9.x milestone Sep 14, 2023
@nathanklick nathanklick modified the milestones: v0.9.x, v0.10.x, v0.11.x Oct 12, 2023
@leninmehedy leninmehedy changed the title Charts[Smoke Tests] Add smoke tests for gateway-api and telemetry ports Charts[Testss] Implement smoke tests and integrate with CI/CD Oct 19, 2023
@leninmehedy leninmehedy added Epic A body of work that can be broken down into specific tasks. and removed New Feature A new feature, service, or documentation. Major changes that are not backwards compatible. Pending Triage New issue that needs to be triaged by the team labels Oct 19, 2023
@leninmehedy leninmehedy modified the milestones: v0.11.x, v0.12.x, v0.13.x Oct 19, 2023
@leninmehedy leninmehedy changed the title Charts[Testss] Implement smoke tests and integrate with CI/CD Charts[Tests] Implement smoke tests and integrate with CI/CD Oct 19, 2023
@leninmehedy leninmehedy changed the title Charts[Tests] Implement smoke tests and integrate with CI/CD Charts[Test] Implement smoke tests and integrate with CI/CD Oct 19, 2023
@leninmehedy leninmehedy moved this from 🔖 Ready to 📋 Backlog in FST Suite Oct 26, 2023
@leninmehedy
Copy link
Member Author

We shall implement this as part of the CLI

@nathanklick nathanklick changed the title Charts[Test] Implement smoke tests and integrate with CI/CD Charts[Test]: Implement smoke tests and integrate with CI/CD Jan 16, 2024
@jeromy-cannon jeromy-cannon removed this from the v0.13.x milestone Feb 23, 2024
@jeromy-cannon
Copy link
Contributor

would be good to use this feature to create unit, integration, and e2e tests for the helm charts. Some useful links to explore further:

Currently, we are still using the make files, and even the helm test <chart name> is not being used in the build process and has minimum functionality. Currently the build process is still using the makefile scripts.

@jeromy-cannon jeromy-cannon added the Pending Triage New issue that needs to be triaged by the team label Sep 3, 2024
@jeromy-cannon jeromy-cannon added Epic Lv2 A body of work that can be broken down into specific tasks. and removed Epic A body of work that can be broken down into specific tasks. labels Sep 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Epic Lv2 A body of work that can be broken down into specific tasks. Pending Triage New issue that needs to be triaged by the team
Projects
Status: 📋 Backlog
Development

No branches or pull requests

3 participants