Skip to content

[deps] enable zstd support #58344

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 9 commits into from
May 20, 2025
Merged

[deps] enable zstd support #58344

merged 9 commits into from
May 20, 2025

Conversation

vtjnash
Copy link
Member

@vtjnash vtjnash commented May 7, 2025

Waiting on JuliaPackaging/Yggdrasil#11183 to update the LLVM shards also

@vtjnash vtjnash marked this pull request as draft May 7, 2025 18:29
@ararslan ararslan added the external dependencies Involves LLVM, OpenBLAS, or other linked libraries label May 8, 2025
@vtjnash vtjnash marked this pull request as ready for review May 14, 2025 15:40
@vtjnash vtjnash requested a review from giordano as a code owner May 14, 2025 15:40
@vtjnash vtjnash force-pushed the jn/zstd branch 2 times, most recently from 52e87ac to 1c8eb09 Compare May 14, 2025 15:45
@vtjnash
Copy link
Member Author

vtjnash commented May 14, 2025

Arg, all of that build effort and the llvm Findzstd script is buggy, producing incorrect results if used with (!MSVC && WIN32)

llvm/llvm-project#139945

@vtjnash vtjnash force-pushed the jn/zstd branch 4 times, most recently from 3f2403b to a90046f Compare May 15, 2025 19:03
@vtjnash vtjnash added the building Build system, or building Julia or its dependencies label May 15, 2025
@vtjnash
Copy link
Member Author

vtjnash commented May 16, 2025

i686-w64-mingw32 is running into the same clang ABI miscompiles as we've encountered before. I guess we got lucky before that zlib didn't smash anything too valuable, while zstd does

The simplest thing to do may be vendor our own copy of the bad code, until the clang compiler stops miscompiling sret stuff https://llvm.org/doxygen/Compression_8cpp_source.html#l00151

vtjnash and others added 8 commits May 17, 2025 17:13
@gbaraldi
Copy link
Member

Can we disable this on 32 bit windows instead?

@vtjnash vtjnash merged commit f03e9c3 into master May 20, 2025
5 of 7 checks passed
@vtjnash vtjnash deleted the jn/zstd branch May 20, 2025 20:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
building Build system, or building Julia or its dependencies external dependencies Involves LLVM, OpenBLAS, or other linked libraries
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants