Vector metric vector_open_files not showing correct data and missing description in documentation #20431
Labels
domain: observability
Anything related to monitoring/observing Vector
source: file
Anything `file` source related
type: bug
A code related bug.
A note for the community
Problem
We are using file source to fetch pod logs and push them to kafka using the kafka sink. We want a mechanism which we can be certain that vector is not losing or laging far behind.
To do so, we saw that there is a metric in vector
vector_open_files
which is not mentioned in the documentation but actually exists. We assume that this metric is at any given time how many files are open by vector for reading.Our configuration is such that at any given time vector agent can be reading at max 2 files (file and the 2nd file created due to rotation containing copy of first file). However in the graph we see that the metric value reaches 3 from time to time. Also when a file is rotated and vector detects it, ideally it should complete reading that file and the vector_open_files should drop to 1.
Our main blocker shifting to vector is a way using which we can absolutely be sure that vector is upto the speed and it not lagging far behind. Also a mechanism using which we can get insights that no data is being lost while file reading.
Configuration
Currently we are testing vector at 20k requests per seconds. Our actual application can have logs produced at about 200k requests per seconds.
We haven't chose the kubernetes_logs source at the moment since we don't want any enrichment
Version
0.37.1
Debug Output
No response
Example Data
No response
Additional Context
No response
References
No response
The text was updated successfully, but these errors were encountered: