New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

faster packaging #17

Open

drernie opened this issue Dec 12, 2023 · 1 comment

Member

drernie commented Dec 12, 2023

Hashing 1 GB of files takes too long (an hour?) for a Lambda.

The real culprit is:

https://quilt-t4-staging.quiltdata.com/b/omics-quilt-omicsquiltckaoutput712023778557useast-1r7hdb9111n3i/tree/outputs/8637245/out/analysis_ready_bam/

I can probably exclude that from the set_dir (perhaps manually). But can I include that some other way?

Member Author

drernie commented Jan 18, 2024

Solved by the new quilt3's s3-style checksums?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment