[sysdig]: vulnerability data stream stops collecting data for very large data #15305
Description
Integration Name
Sysdig [sysdig]
Dataset Name
sysdig.vulnerability
Integration Version
2.1.0
Agent Version
8.16.0
Agent Output Type
elasticsearch
Elasticsearch Version
8.16.0
OS Version and Architecture
elastic-package
Software/API Version
No response
Error Message
Didn't receive any specific error.
Event Original
No response
What did you do?
Configure the Sysdig vulnerability data stream using the default parameters.
What did you see?
After saving the integration, I didn't receive any data or errors on the Discover page, even though I enabled debug logging for the agent. The diagnostics also don't show any errors. In the diagnostics, the CEL execution never completed (the response state never appears in the logs), but the request state message is seen many times. It seems the input was killed due to an out-of-memory issue and then restarted.
This issue has only occurred with a large amount of data.
What did you expect to see?
Data collection should gather logs, and they should be visible on the Discover page.
Anything else?
This issue has only occurred with a large amount of data.