Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SplitStore]Save the chain data with the multi badgerdbs(support daily or weekly...) #10668

Open
3 of 9 tasks
OneilYang opened this issue Apr 14, 2023 · 0 comments
Open
3 of 9 tasks
Labels
area/chain Area: Chain kind/feature Kind: Feature need/analysis Hint: Needs Analysis P3 P3: Might get resolved

Comments

@OneilYang
Copy link

Checklist

  • This is not brainstorming ideas. If you have an idea you'd like to discuss, please open a new discussion on the lotus forum and select the category as Ideas.
  • I have a specific, actionable, and well motivated feature request to propose.

Lotus component

  • lotus daemon - chain sync
  • lotus fvm/fevm - Lotus FVM and FEVM interactions
  • lotus miner/worker - sealing
  • lotus miner - proving(WindowPoSt/WinningPoSt)
  • lotus JSON-RPC API
  • lotus message management (mpool)
  • Other

What is the motivation behind this feature request? Is your feature request related to a problem? Please describe.

As for #10659
I have the better feature request:
In the privious version, we only have the main badgerdb to save data,
and then we use more badgerdbs to save hot, cold/ marked data..., now we already have many badgerdb, but it actually too compclicated we got long time to do this and it will interupt the chain sync ( which comes more issues)
so I have a simple and much better feature request

Describe the solution you'd like

support multi badgerdb to save chain data such as daily or weekly, and the older badgerdb can be removed directly
if this, we don't need the gc and just remove the older badgerdbs, it's great

Describe alternatives you've considered

For example:
Save the data to one badgerdb from lotus starttime ~ 24 hours to one folder, and everyday add the new one
../splitstore/hot.202xyy01...
../splitstore/hot.202xyy02...
lotus will use all badgerdb found in his ../splitstore

Additional context

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/chain Area: Chain kind/feature Kind: Feature need/analysis Hint: Needs Analysis P3 P3: Might get resolved
Projects
None yet
Development

No branches or pull requests

2 participants