Skip to content

Use multi-core optimized pgzip package for tar traversal#669

Merged
jpalermo merged 4 commits intomainfrom
pgzip
Nov 21, 2024
Merged

Use multi-core optimized pgzip package for tar traversal#669
jpalermo merged 4 commits intomainfrom
pgzip

Conversation

@rkoster
Copy link
Contributor

@rkoster rkoster commented Oct 16, 2024

This PR is blocked by: cloudfoundry/bosh-utils#98

import (
"archive/tar"
"compress/gzip"
gzip "github.com/klauspost/pgzip"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as in bosh-utils: this import alias only hides info, would recommend removing it.

also putting non-standard-lib imports here will make the linter 😡

@rkoster
Copy link
Contributor Author

rkoster commented Oct 24, 2024

Blocked on bosh-utils ci being broken

@rkoster rkoster force-pushed the pgzip branch 2 times, most recently from ab0eeea to 700ca89 Compare November 21, 2024 13:46
@jpalermo jpalermo merged commit 9092ca1 into main Nov 21, 2024
@jpalermo jpalermo deleted the pgzip branch November 21, 2024 15:45
selzoc added a commit that referenced this pull request Dec 16, 2024
This is basically a revert of
#669.

We found that the bosh cli with the pgzip code produces releases that
cannot be compiled by the bosh agent.  In addition, there were many many
edge cases that we found we had to fix and/or paper over that have been
solved in the tar executable over the past decades.

Maybe in the future we can give this another go, as the performance
improvements would be welcome.

Signed-off-by: Ming Xiao <ming.xiao@broadcom.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Development

Successfully merging this pull request may close these issues.

3 participants