Closed
Description
openedon Aug 25, 2022
We have some tooling for testing integrations, but I think there is a gap here. We support two types of tests:
- Verifying that the basic Elasticsearch and Kibana assets are installable and that the ingest pipeline can ingest data
- A full end-to-end "system" test that will install Agent and the integration and verify that data is shipped, processed, and index correctly. These are much more work to set up and slower and flakier to execute.
I think we need something in between that validates the final agent policy that is produced by Kibana when the package is rendered with different variable values. This would help in cases like elastic/integrations#3074.
Conceptually these would work like:
- Set up Kibana and Elasticsearch
- Install the package
- For each test scenario
- Create a package policy given set of input variables
- Assert that the generated agent policy matches what is expected by the package author
- Assert that the generated agent policy is a valid one in general (note we actually have no spec for what this is today, so we'd need this)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment