Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support compression algorithms with better compression ratios, like zstd #3671

Closed
flowbehappy opened this issue Dec 17, 2021 · 0 comments · Fixed by #4161
Closed

Support compression algorithms with better compression ratios, like zstd #3671

flowbehappy opened this issue Dec 17, 2021 · 0 comments · Fixed by #4161
Assignees
Labels
type/feature-request Categorizes issue or PR as related to a new feature.

Comments

@flowbehappy
Copy link
Contributor

flowbehappy commented Dec 17, 2021

Feature Request

Is your feature request related to a problem? Please describe:
The data size of TiFlash replica can be larger than TiKV in some cases. Because by default, the most data of TiKV (the highest layer) is compressed by zstd, while TiFlash only uses lz4. And normally, the compression ratio of zstd is 1.5 times that of lz4.

For TPCC, the data size of TiKV is 51 GB, while TiFlash is 53 GB (with logical split disabled).

Describe the feature you'd like:
Support compression algorithms with better compression ratios, like zstd. Maybe automatically choose the best algorithm for different dataset / columns.

Describe alternatives you've considered:

Teachability, Documentation, Adoption, Migration Strategy:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/feature-request Categorizes issue or PR as related to a new feature.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants