indefinitely logged warning for 1-line file too large for max_line_bytes

[jdef]

A note for the community

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment

Problem

every 10s vector logs:

Found line that exceeds max_line_bytes; discarding.

The file is mostly static. It only ever changes when a proc restarts, which is very infrequently. But vector still logs the same warning.

In this case, the file contains a single line containing more bytes than max_line_bytes allows. And since it's mostly static, it appears that vector attempts to re-read the same file every 10s (even though it hasn't changed, vector re-attempts to read contents that it knows are too large).

Configuration

# air-gapped system won't let me copy/paste,
# apologies in advance for typos.

data_dir = "/tmp"

# dd if=/dev/zero of=/tmp/boo bs=1024 count=101
[sources.zero]
type = "file"
include = ["/tmp/boo"]
fingerprint.strategy = "device_and_inode"

[sinks.out]
type = "console"
inputs = ["zero"]
encoding.codec = "json"

Version

0.25.2, 0.28.1

Debug Output

No response

Example Data

No response

Additional Context

It's worth noting that changing fingerprint.strategy to checksum doesn't help

References

No response

[fuchsnj]

Thanks for the report. I'm able to reproduce this with the config you gave on 0.28.0