You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Now, when meta information of TimeMergeStorage changes, the efficiency of persisting manifest sst files is very low. Each time, the new sst file will be added to the manifest and then persisted it whole.
Proposal
Each time, the new sst file will be persisted instantly, then add the new sst into snapshot background.
The manifest file is organized as follows:
When initializing the manifest, we will list all the sst files in the manifest directory and then add them into the snapshot
Every time a new file is added, we will count the new files. When the number of new files reaches 50, we will list all the sst files in the manifest directory and then add them into the snapshot
The text was updated successfully, but these errors were encountered:
Describe This Problem
Now, when meta information of TimeMergeStorage changes, the efficiency of persisting manifest sst files is very low. Each time, the new sst file will be added to the manifest and then persisted it whole.
Proposal
Each time, the new sst file will be persisted instantly, then add the new sst into snapshot background.
The manifest file is organized as follows:
Additional Context
Process manifest files:
The text was updated successfully, but these errors were encountered: