Skip to content

Add incremental snapshot support#4198

Open
pcholakov wants to merge 3 commits intosnapshot-leasesfrom
incremental-snapshots
Open

Add incremental snapshot support#4198
pcholakov wants to merge 3 commits intosnapshot-leasesfrom
incremental-snapshots

Conversation

@pcholakov
Copy link
Contributor

@pcholakov pcholakov commented Jan 16, 2026

@github-actions
Copy link

github-actions bot commented Jan 16, 2026

Test Results

  7 files  ±0    7 suites  ±0   2m 44s ⏱️ -1s
 47 tests ±0   47 ✅ ±0  0 💤 ±0  0 ❌ ±0 
200 runs  ±0  200 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 76338d9. ± Comparison against base commit 330e2cb.

♻️ This comment has been updated with latest results.

@pcholakov pcholakov force-pushed the incremental-snapshots branch from 63f4f05 to 70fa77f Compare January 16, 2026 13:26
@pcholakov pcholakov force-pushed the incremental-snapshots branch 5 times, most recently from a9b66d2 to 754225f Compare January 19, 2026 07:52
@pcholakov pcholakov changed the title [WIP] Incremental snapshots Incremental snapshots Jan 19, 2026
@pcholakov pcholakov force-pushed the incremental-snapshots branch 2 times, most recently from 93f9a83 to 8d4a315 Compare January 19, 2026 14:53
@pcholakov pcholakov force-pushed the incremental-snapshots branch from 8d4a315 to 6e31300 Compare January 19, 2026 17:01
@pcholakov pcholakov force-pushed the incremental-snapshots branch from 6e31300 to 7bfffab Compare January 20, 2026 09:19
@pcholakov pcholakov changed the base branch from pavel/qnkxqqrvzqyx to snapshot-leases January 20, 2026 09:26
@pcholakov pcholakov force-pushed the incremental-snapshots branch 2 times, most recently from ef734f0 to 110115e Compare January 20, 2026 09:50
@pcholakov pcholakov changed the title Incremental snapshots Add incremental snapshot support Jan 20, 2026
@pcholakov pcholakov force-pushed the incremental-snapshots branch from 110115e to fdfe0d1 Compare January 20, 2026 10:16
}
}

async fn compute_content_hash(path: &Path) -> io::Result<ContentHash> {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we think it would be beneficial I can convert this to mmap - I didn't want to introduce new dependencies, haven't really tested this for performance so tips for obvious improvements welcome!

Use content-based hash naming for shared SSTs

Add config option to set snapshot startup delay

resolve: incremental snapshot support conflict
@pcholakov pcholakov force-pushed the incremental-snapshots branch from 3f65f6f to 76338d9 Compare February 1, 2026 19:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant