Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

header: storage/disk usage optimizations #671

Open
1 of 5 tasks
Wondertan opened this issue May 4, 2022 · 0 comments
Open
1 of 5 tasks

header: storage/disk usage optimizations #671

Wondertan opened this issue May 4, 2022 · 0 comments
Labels
area:header Extended header enhancement New feature or request

Comments

@Wondertan
Copy link
Member

Wondertan commented May 4, 2022

  • Store only one copy of the validator address/pub keys.
    • Currently, we store the full validator set per each Header which is redundant as they are usually overlapping.
    • For this to happen, we may introduce an additional Validator service/module with its own pkg and the Store interface.
    • Also, this epic should ideally include changes in syncing of validator sets. Specifically, the delta of validators should be fetched and not the whole validator set, as it is right now.
  • Pruning of headers. Nodes do not trust headers beyond the unbonding period and can remove them. Still, we should provide an API for Nodes that can fetch headers from the DA network upon request.
  • Cryptography aware serialization format. Currently, we use protobuf which prefixes all the serialized data with its length, including constant size hashes and signatures.
  • BLS signatures aggregation would allow us to store 1 signature instead of N validator signature per Header. This is something out of the scope of celestia-node and heavily dependent on Core/Tendermint. Fortunately, the Tendermint team is going in the direction of implementing the BLS signatures as outlined in the doc.
  • deps: update to badgerv4 #482
    This will decrease disk storage usage for each value written in badger, as it uses different serialization format since v3
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:header Extended header enhancement New feature or request
Projects
No open projects
Status: TODO
Development

No branches or pull requests

2 participants