ARM64 static compilation fails with linking errors

[proofrock]

/usr/bin/ld: (.text+0x10): warning: too many GOT entries for -fpic, please recompile with -fPIC

This blocks #49 too...

 > [build 4/4] RUN make build-static:
598.9 /usr/bin/ld: /go/pkg/mod/github.com/marcboeker/go-duckdb@v1.8.3/deps/linux_arm64/libduckdb.a(ub_duckdb_common.cpp.o): in function `duckdb::LocalFileSystem::OpenFile(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, duckdb::FileOpenFlags, duckdb::optional_ptr<duckdb::FileOpener, true>)':
598.9 ub_duckdb_common.cpp:(.text+0x6258c): warning: Using 'getpwuid' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
598.9 /usr/bin/ld: /go/pkg/mod/github.com/marcboeker/go-duckdb@v1.8.3/deps/linux_arm64/libduckdb.a(ub_duckdb_main_extension.cpp.o): in function `duckdb_httplib::detail::create_client_socket(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, int, int, bool, std::function<void (int)>, long, long, long, long, long, long, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, duckdb_httplib::Error&)::{lambda(int, addrinfo&)#1}::operator()(int, addrinfo&) const':
598.9 ub_duckdb_main_extension.cpp:(.text._ZZN14duckdb_httplib6detail20create_client_socketERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_iibSt8functionIFviEEllllllS8_RNS_5ErrorEENKUliR8addrinfoE_clEiSF_[_ZZN14duckdb_httplib6detail20create_client_socketERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_iibSt8functionIFviEEllllllS8_RNS_5ErrorEENKUliR8addrinfoE_clEiSF_]+0x1f0): warning: Using 'getaddrinfo' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking
598.9 /usr/lib/gcc/aarch64-linux-gnu/12/../../../aarch64-linux-gnu/libc.a(init-first.o): in function `__libc_init_first':
598.9 (.text+0x10): relocation truncated to fit: R_AARCH64_LD64_GOTPAGE_LO15 against symbol `__environ' defined in .bss section in /usr/lib/gcc/aarch64-linux-gnu/12/../../../aarch64-linux-gnu/libc.a(environ.o)
598.9 /usr/bin/ld: (.text+0x10): warning: too many GOT entries for -fpic, please recompile with -fPIC
598.9 collect2: error: ld returned 1 exit status
598.9 
599.0 make: *** [Makefile:28: build-static] Error 1

[proofrock]

Opened upstream issue marcboeker/go-duckdb#352

[proofrock]

After many experiments, I was able to build duckdb statically with musl and -fPIC, using Alpine Linux, both on amd64 and arm64. This last build was done using qemu: alpinelinux/alpine-chroot-install in linux, or jirutka/setup-alpine in github actions.

# as root
apk add --no-cache findutils musl-dev go g++ git make cmake ninja openssl openssl-dev openssl-libs-static python3 zstd
git clone -b "v1.1.3" https://github.com/duckdb/duckdb
cd duckdb
CFLAGS="-O3 -fPIC" CXXFLAGS="-O3 -fPIC" BUILD_SHELL=0 BUILD_UNITTESTS=0 DUCKDB_PLATFORM=any ENABLE_EXTENSION_AUTOLOADING=1 ENABLE_EXTENSION_AUTOINSTALL=1 BUILD_EXTENSIONS="json;httpfs;parquet" make bundle-library -j4
# use duckdb/build/release/libduckdb_bundle.a 

This .a library was then put into the ws4sql src/ dir, and the main binary was compiled with:

cd src
CGO_CFLAGS="-O2 -fPIC" CGO_CXXFLAGS="-O2 -fPIC" CGO_LDFLAGS="-lduckdb_bundle -lssl -lcrypto -L./" go build -buildvcs=false -trimpath -a -tags="netgo osusergo sqlite_omit_load_extension duckdb_use_static_lib" -ldflags='-w -extldflags "-static"'

Given that compiling duckdb takes a long time, I saved the .a file in the precompiled/ dir.