Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loading delayed data into Thanos #5522

Open
kojderszymon opened this issue Jul 19, 2022 · 2 comments
Open

Loading delayed data into Thanos #5522

kojderszymon opened this issue Jul 19, 2022 · 2 comments
Labels

Comments

@kojderszymon
Copy link

I am using Minio and Thanos (with receiver) to collect data from Prometheus and my own application via remote write. A problem arises when via remote write I would like to upload older, late data. With the default settings, I can upload data from a few hours ago, but this is not enough. For example, I would like to load data from 24 hours ago. Will I be able to achieve this? Will increasing --max-block-duration and --min-block-duration solve the problem? Is there any work to solve my problem currently being done?

@fpetkovski
Copy link
Contributor

This is a limitation with the Prometheus TSDB. The only way to backfill data older than a few hours is to upload TSDB blocks directly to S3 from where you can query them with Store Gateway.

@stale
Copy link

stale bot commented Oct 1, 2022

Hello 👋 Looks like there was no activity on this issue for the last two months.
Do you mind updating us on the status? Is this still reproducible or needed? If yes, just comment on this PR or push a commit. Thanks! 🤗
If there will be no activity in the next two weeks, this issue will be closed (we can always reopen an issue if we need!). Alternatively, use remind command if you wish to be reminded at some point in future.

@stale stale bot added the stale label Oct 1, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants