Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trigger compaction prior retention. #3665

Merged
merged 9 commits into from
Apr 30, 2021
Merged

Trigger compaction prior retention. #3665

Changes from 1 commit
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
dd582e6
Trigger compaction prior retention.
cyriltovena Apr 29, 2021
6687145
Hook retention into compaction.
cyriltovena Apr 29, 2021
0d6cdcb
Remove unused flags.
cyriltovena Apr 29, 2021
cbe8aff
Better comment.
cyriltovena Apr 29, 2021
b664b90
Better cancellation.
cyriltovena Apr 29, 2021
dcf018e
Missing ctx in test.
cyriltovena Apr 29, 2021
14df469
Fixes flags that are not used.
cyriltovena Apr 29, 2021
1d31dd3
Add compactor retention tests.
cyriltovena Apr 30, 2021
3ea0c03
Review feedback.
cyriltovena Apr 30, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Remove unused flags. 
Signed-off-by: Cyril Tovena <cyril.tovena@gmail.com>
  • Loading branch information
@cyriltovena
cyriltovena committed Apr 29, 2021
commit 0d6cdcb318a8f8633fb966e59e63f2e54fefed4d
3 changes: 1 addition & 2 deletions pkg/storage/stores/shipper/compactor/compactor.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,8 +42,7 @@ func (cfg *Config) RegisterFlags(f *flag.FlagSet) {
f.StringVar(&cfg.WorkingDirectory, "boltdb.shipper.compactor.working-directory", "", "Directory where files can be downloaded for compaction.")
f.StringVar(&cfg.SharedStoreType, "boltdb.shipper.compactor.shared-store", "", "Shared store used for storing boltdb files. Supported types: gcs, s3, azure, swift, filesystem")
f.StringVar(&cfg.SharedStoreKeyPrefix, "boltdb.shipper.compactor.shared-store.key-prefix", "index/", "Prefix to add to Object Keys in Shared store. Path separator(if any) should always be a '/'. Prefix should never start with a separator but should always end with it.")
f.DurationVar(&cfg.CompactionInterval, "boltdb.shipper.compactor.compaction-interval", 2*time.Hour, "Interval at which to re-run the compaction operation.")
f.DurationVar(&cfg.RetentionInterval, "boltdb.shipper.compactor.retention-interval", 10*time.Minute, "Interval at which to re-run the retention operation.")
cyriltovena marked this conversation as resolved.
Show resolved Hide resolved
f.DurationVar(&cfg.CompactionInterval, "boltdb.shipper.compactor.compaction-interval", 10*time.Minute, "Interval at which to re-run the compaction operation.")
f.DurationVar(&cfg.RetentionDeleteDelay, "boltdb.shipper.compactor.retention-delete-delay", 2*time.Hour, "Delay after which chunks will be fully deleted during retention.")
f.BoolVar(&cfg.RetentionEnabled, "boltdb.shipper.compactor.retention-enabled", false, "(Experimental) Activate custom (per-stream,per-tenant) retention.")
f.IntVar(&cfg.RetentionDeleteWorkCount, "boltdb.shipper.compactor.retention-delete-worker-count", 150, "The total amount of worker to use to delete chunks.")
Expand Down