Skip to content

Conversation

@kim
Copy link
Contributor

@kim kim commented Apr 7, 2025

This patch seeks to stabilize (for internal use) an API to synchronize a
remote snapshot repository with a local one.

The implementation ensures that:

  1. Transferred objects are verified to match the snapshot file's hashes
    before being made persistent in the snapshot's object repository.
  2. The snapshot file itself is written only after all objects have been
    stored successfully.

This makes it possible for the receiving end to infer from an uncorrupted
snapshot file being present that the snapshot as a whole is consistent
with reasonably high confidence. In a replicated setup this is a
valuable property.

API and ABI breaking changes

  • no

Expected complexity level and risk

2

Testing

  • yes

@kim kim requested review from Shubham8287 and gefjon April 7, 2025 12:54
@bfops bfops added the release-any To be landed in any release window label Apr 7, 2025
@kim kim force-pushed the kim/snapshot/transfer branch from b811e21 to 66092ab Compare April 8, 2025 06:11
@kim kim enabled auto-merge April 8, 2025 06:11
This patch seeks to stabilize (for internal use) an API to synchronize a
remote snapshot repository with a local one.

The implementation ensures that:

1. Transferred objects are verified to match the snapshot file's hashes
   before being made persistent in the snapshot's object repository.
2. The snapshot file itself is written only after all objects have been
   stored successfully.

This makes it possible for the receiving end to infer from an uncorrupted
snapshot file being present that the snapshot as a whole is consistent
with reasonably high confidence. In a replicated setup this is a
valuable property.
@kim kim force-pushed the kim/snapshot/transfer branch from 66092ab to 9f3b8a5 Compare April 8, 2025 07:11
@kim kim added this pull request to the merge queue Apr 8, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Apr 8, 2025
@kim kim added this pull request to the merge queue Apr 8, 2025
Merged via the queue into master with commit 85c347c Apr 8, 2025
13 of 14 checks passed
@kim kim deleted the kim/snapshot/transfer branch April 8, 2025 08:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release-any To be landed in any release window

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants