Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

zstd: Add better compression mode #240

Merged
merged 5 commits into from
Mar 9, 2020
Merged

Commits on Mar 7, 2020

  1. zstd: Add better compression mode

    Add compression mode that is better than default.
    
    Approximately 50% of the speed with overall improvement. Roughly the same as zstd level 7.
    
    Some comparisons (best of 3 runs):
    
    ```
    file	out	level	insize	outsize	millis	mb/s
    enwik9	zskp	2	1000000000	317517832	7452	127.96
    enwik9	zskp	3	1000000000	298846117	14109	67.59
    
    nyc-taxi-data-10M.csv	zskp	2	3325605752	595200765	14299	221.80
    nyc-taxi-data-10M.csv	zskp	3	3325605752	560393969	25808	122.89
    
    github-june-2days-2019.json	zskp	2	6273951764	640407088	14517	412.15
    github-june-2days-2019.json	zskp	3	6273951764	628859544	36950	161.93
    
    rawstudio-mint14.tar	zskp	2	8558382592	3379874208	42571	191.72
    rawstudio-mint14.tar	zskp	3	8558382592	3301556598	93862	86.96
    ```
    klauspost committed Mar 7, 2020
    Configuration menu
    Copy the full SHA
    27bf903 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    4cf2a29 View commit details
    Browse the repository at this point in the history
  3. doc+test tweaks.

    klauspost committed Mar 7, 2020
    Configuration menu
    Copy the full SHA
    f18f44d View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2020

  1. Clean up.

    klauspost committed Mar 8, 2020
    Configuration menu
    Copy the full SHA
    ab26bf5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1bd81db View commit details
    Browse the repository at this point in the history