[FileReader] Upon restart, it ingests already ingested logs.

[rockb1017]

Describe the bug
When I upgrade otel helm chart, it recreates collector pod, then I have duplicate of logs.
So the file checkpointing is not working properly.

[tigrannajaryan]

@rockb1017 Checkpoint saving is not implemented yet, see #2287. Also, show your config to make reproduction easier.

@djaglowski is it expected that for now on restart we will re-read already read files or that we will completely skip them?

[djaglowski]

As Tigran mentioned, checkpoints depend on #2287, which is in progress.

In the absence of a checkpoint, the behavior is controlled by the start_at configuration parameter, documented here.

[djaglowski]

I believe this is resolved, now that the file_storage extension is available. Note that a file_storage extension needs to be configured in order for this to work.