You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The server will now have a single logical WAL, this issue tracks implementing this new WAL, a precursor to getting the server refactored to use it. It will have the following properties:
The WAL will be written to a configured object store
The WAL will have an enum of Entry that will have different operations (writelp, write parquet, write snapshot file, etc.)
Each entry will have a monotonically increasing u64 sequence number
The WAL will be comprised of individual files, each being identified by their own sequence number
Writes to the WAL will be buffered up on a flush interval (default 1s), after which a file will be written with its sequence number as the filename
After N + N/2 files have been created, a snapshot will be run (N is configurable, default is 600 (i.e. snapshot after we have 900 files with the goal of reaping the first 600. Thus snapshotting every 10 minutes by default)
Snapshot should be an interface that the WAL gets initialized with
Once the snapshot is complete and successful, remove the first 600 files
The WAL should be able to be initialized empty or pointed to an existing object store. All WAL files should be read and replayed in order. There will be an interface to replay WAL entries.
The text was updated successfully, but these errors were encountered:
The server will now have a single logical WAL, this issue tracks implementing this new WAL, a precursor to getting the server refactored to use it. It will have the following properties:
The WAL should be able to be initialized empty or pointed to an existing object store. All WAL files should be read and replayed in order. There will be an interface to replay WAL entries.
The text was updated successfully, but these errors were encountered: