Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cmd,pkg: flush storage when hashring changes #1480

Merged
merged 2 commits into from
Sep 30, 2019
Merged

cmd,pkg: flush storage when hashring changes #1480

merged 2 commits into from
Sep 30, 2019

Commits on Sep 27, 2019

  1. pkg/receive: create flushable storage 

    Signed-off-by: Lucas Servén Marín <lserven@gmail.com>
    @squat
    squat committed Sep 27, 2019
    Configuration menu
    Copy the full SHA
    8c4d743 View commit details
    Browse the repository at this point in the history

  2. cmd,pkg: flush storage when hashring changes 

    In order to allow the hashring of receive nodes to scale at runtime, we
need to temporarily stop the storage, flush it, and upload the blocks.
This commit ensures that whenever a hashring change is detected, the
entire storage is flushed and the shipper is notified so that is uploads
any new blocks. It also ensures that when the receive component starts
up, any in-progress WAL is flushed and uploaded. This ensures that
new data that may belong to a different tenant is not mixed with old
data. Finally, it also ensures that the storage is flushed and uploaded
whenever the process shuts down.

Signed-off-by: Lucas Servén Marín <lserven@gmail.com>
    @squat
    squat committed Sep 27, 2019
    Configuration menu
    Copy the full SHA
    2bf7f64 View commit details
    Browse the repository at this point in the history