[lld] Not creating fully statically linked binaries on Alpine Linux

[benz0li]

Your environment

Which OS do you use? Alpine Linux 3.21.3

Which version of LLVM do you use and how did you install it? Version 18. Installed using apk.

Expected behaviour

E.g. building https://github.com/jgm/pandoc using cabal update && cabal build --enable-executable-static --ghc-options '-optl-pthread' pandoc-cli in quay.io/benz0li/ghc-musl:9.10.1-int-native (big-integer backend: native; default linker: ld.bfd):

ldd /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

/lib/ld-musl-aarch64.so.1: /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc: Not a valid dynamic program

---

file /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

/tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, BuildID[sha1]=0f5f5dfdb712dcea7d9322a55303eb37486d114d, with debug_info, not stripped

Actual behaviour

When using a GHC musl image with ld.lld as default linker¹:

ldd /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

	/lib/ld-musl-aarch64.so.1 (0xffff9e133000)

---

file /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

/tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), dynamically linked, BuildID[xxHash]=a31bd72d4c384ddd, with debug_info, not stripped

Footnotes

1. docker build --build-arg GHC_NATIVE_BIGNUM=1 -t ghc-musl:9.10.1-int-native-lld -f dockerfiles/9.10.1.Dockerfile . ↩

[benz0li]

When using images with gmp big-integer implementation + ld.lld as default linker, static linking fails entirely:

• https://gitlab.b-data.ch/ghc/ghc-musl/-/jobs/167692
• https://gitlab.b-data.ch/ghc/ghc-musl/-/jobs/167693

[benz0li]

Cross reference:

• ld.lld (the LLVM linker) is missing in the images benz0li/ghc-musl#13

[EugeneZelenko]

Could you please try 20 or main branch?

[llvmbot]

@llvm/issue-subscribers-lld-elf

Author: Olivier Benz (benz0li)

### Your environment

Which OS do you use? Alpine Linux 3.21.3

Which version of LLVM do you use and how did you install it? Version 18. Installed using apk.

Expected behaviour

E.g. building https://github.com/jgm/pandoc using cabal update && cabal build --enable-executable-static --ghc-options '-optl-pthread' pandoc-cli in quay.io/benz0li/ghc-musl:9.10.1-int-native (bignum implementation: native; default linker: ld.bfd):

ldd /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

/lib/ld-musl-aarch64.so.1: /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc: Not a valid dynamic program

---

file /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

/tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, BuildID[sha1]=0f5f5dfdb712dcea7d9322a55303eb37486d114d, with debug_info, not stripped

Actual behaviour

When using a GHC musl image with ld.lld as default linker¹:

ldd /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

	/lib/ld-musl-aarch64.so.1 (0xffff9e133000)

---

file /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

/tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), dynamically linked, BuildID[xxHash]=a31bd72d4c384ddd, with debug_info, not stripped

Footnotes

1. docker build --build-arg GHC_NATIVE_BIGNUM=1 -t ghc-musl:9.10.1-int-native-lld -f dockerfiles/9.10.1.Dockerfile . ↩

[benz0li]

Could you please try 20 or main branch?

I am currently trying to build a new image based on a modified dockerfiles/9.10.1.Dockerfile:

diff --git a/dockerfiles/9.10.1.Dockerfile b/dockerfiles/9.10.1.Dockerfile
index f2f3e38..81bd692 100644
--- a/dockerfiles/9.10.1.Dockerfile
+++ b/dockerfiles/9.10.1.Dockerfile
@@ -100,7 +100,7 @@ RUN cabal update \
   ## See https://gitlab.haskell.org/ghc/ghc/-/wikis/commentary/libraries/version-history
   && cabal install "cabal-install-$CABAL_VERSION"
 
-FROM alpine:3.21 AS ghc-base
+FROM alpine:edge AS ghc-base
 
 ARG IMAGE_LICENSE="MIT"
 ARG IMAGE_SOURCE="https://gitlab.b-data.ch/ghc/ghc-musl"
@@ -115,12 +115,12 @@ LABEL org.opencontainers.image.licenses="$IMAGE_LICENSE" \
 ARG GHC_VERSION_BUILD
 ARG CABAL_VERSION_BUILD
 ARG STACK_VERSION
-ARG LLVM_VERSION
+ARG LLVM_VERSION_OVERRIDE=20
 
 ENV GHC_VERSION=${GHC_VERSION_BUILD} \
     CABAL_VERSION=${CABAL_VERSION_BUILD} \
     STACK_VERSION=${STACK_VERSION} \
-    LLVM_VERSION=${LLVM_VERSION}
+    LLVM_VERSION=${LLVM_VERSION_OVERRIDE}
 
 RUN apk add --no-cache \
     bash \
@@ -128,7 +128,7 @@ RUN apk add --no-cache \
     bzip2 \
     bzip2-dev \
     bzip2-static \
-    clang${LLVM_VERSION} \
+    clang${LLVM_VERSION_OVERRIDE} \
     curl \
     curl-static \
     dpkg \
@@ -138,8 +138,8 @@ RUN apk add --no-cache \
     libcurl \
     libffi \
     libffi-dev \
-    lld${LLVM_VERSION} \
-    llvm${LLVM_VERSION} \
+    lld${LLVM_VERSION_OVERRIDE} \
+    llvm${LLVM_VERSION_OVERRIDE} \
     ncurses-dev \
     ncurses-static \
     openssl-dev \

If the build succeeds, I will publish the image: glcr.b-data.ch/ghc/ghc-musl:9.10.1-int-native-lld20

[benz0li]

No Issue (on both Alpine Linux/x86_64 and Alpine Linux/AArch64) when using the image with [Haskell-]native big-integer backend + [LLVM] lld version 20:

ld.lld --version

LLD 20.1.3 (compatible with GNU linkers

---

ghc --info

 [("Project name","The Glorious Glasgow Haskell Compilation System")
 ,("C compiler command","gcc")
 ,("C compiler flags","")
 ,("C++ compiler command","g++")
 ,("C++ compiler flags","")
 ,("C compiler link flags","-fuse-ld=lld -Wl,--no-as-needed -Wl,-z,noexecstack")
 ,("C compiler supports -no-pie","YES")
 ,("CPP command","gcc")
 ,("CPP flags","-E")
 ,("Haskell CPP command","gcc")
 ,("Haskell CPP flags","-E -undef -traditional")
 ,("ld supports compact unwind","NO")
 ,("ld supports filelist","NO")
 ,("ld supports single module","NO")
 ,("ld is GNU ld","YES")
 ,("Merge objects command","/usr/bin/ld.lld")
 ,("Merge objects flags","-r")
 ,("Merge objects supports response files","YES")
 ,("ar command","ar")
 ,("ar flags","q")
 ,("ar supports at file","YES")
 ,("ar supports -L","NO")
 ,("ranlib command","ranlib")
 ,("otool command","otool")
 ,("install_name_tool command","install_name_tool")
 ,("windres command","/bin/false")
 ,("unlit command","/usr/local/lib/ghc-9.10.1/lib/../bin/unlit")
 ,("cross compiling","NO")
 ,("target platform string","aarch64-alpine-linux")
 ,("target os","OSLinux")
 ,("target arch","ArchAArch64")
 ,("target word size","8")
 ,("target word big endian","NO")
 ,("target has GNU nonexec stack","YES")
 ,("target has .ident directive","YES")
 ,("target has subsections via symbols","NO")
 ,("target has libm","YES")
 ,("Unregisterised","NO")
 ,("LLVM target","aarch64-alpine-linux")
 ,("LLVM llc command","llc")
 ,("LLVM opt command","opt")
 ,("LLVM llvm-as command","clang")
 ,("Use inplace MinGW toolchain","NO")
 ,("Use interpreter","YES")
 ,("Support SMP","YES")
 ,("RTS ways","v thr thr_debug thr_debug_p thr_debug_dyn thr_p thr_dyn debug debug_p debug_dyn p dyn")
 ,("Tables next to code","YES")
 ,("Leading underscore","NO")
 ,("Use LibFFI","YES")
 ,("RTS expects libdw","NO")
 ,("Project version","9.10.1")
 ,("Project Git commit id","6d779c0fab30c39475aef50d39064ed67ce839d7")
 ,("Project Version Int","910")
 ,("Project Patch Level","1")
 ,("Project Patch Level1","1")
 ,("Project Patch Level2","0")
 ,("Project Unit Id","ghc-9.10.1-inplace")
 ,("Booter version","9.8.2")
 ,("Stage","2")
 ,("Build platform","aarch64-alpine-linux")
 ,("Host platform","aarch64-alpine-linux")
 ,("Target platform","aarch64-alpine-linux")
 ,("Have interpreter","YES")
 ,("Object splitting supported","NO")
 ,("Have native code generator","YES")
 ,("target has RTS linker","YES")
 ,("Target default backend","native code generator")
 ,("Support dynamic-too","YES")
 ,("Support parallel --make","YES")
 ,("Support reexported-modules","YES")
 ,("Support thinning and renaming package flags","YES")
 ,("Support Backpack","YES")
 ,("Requires unified installed package IDs","YES")
 ,("Uses package keys","YES")
 ,("Uses unit IDs","YES")
 ,("GHC Dynamic","YES")
 ,("GHC Profiled","NO")
 ,("Debug on","NO")
 ,("LibDir","/usr/local/lib/ghc-9.10.1/lib")
 ,("Global Package DB","/usr/local/lib/ghc-9.10.1/lib/package.conf.d")
 ]

---

ldd /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

/lib/ld-musl-aarch64.so.1: /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc: Not a valid dynamic program

---

file /tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc

/tmp/pandoc/dist-newstyle/build/aarch64-linux/ghc-9.10.1/pandoc-cli-3.6.4/x/pandoc/build/pandoc/pandoc: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, BuildID[sha1]=0c2877ba91507ec6013c9a73b6999853564fe9c2, with debug_info, not stripped

[benz0li]

I will retest static linking with the images using gmp big-integer implementation + ld.lld as default linker.

[benz0li]

I will retest static linking with the images using gmp big-integer implementation + ld.lld as default linker.

ghc -static -optl-pthread -optl-static Main.hs

[1 of 2] Compiling Main             ( Main.hs, Main.o )
[2 of 2] Linking Main
/usr/lib/gcc/aarch64-alpine-linux-musl/14.2.0/../../../../aarch64-alpine-linux-musl/bin/ld: cannot find -lgmp: No such file or directory
/usr/lib/gcc/aarch64-alpine-linux-musl/14.2.0/../../../../aarch64-alpine-linux-musl/bin/ld: have you installed the static version of the gmp library ?
collect2: error: ld returned 1 exit status
ghc-9.10.1: `gcc' failed in phase `Linker'. (Exit code: 1)
HasCallStack backtrace:
  collectBacktraces, called at libraries/ghc-internal/src/GHC/Internal/Exception.hs:92:13 in ghc-internal:GHC.Internal.Exception
  toExceptionWithBacktrace, called at libraries/ghc-internal/src/GHC/Internal/IO.hs:260:11 in ghc-internal:GHC.Internal.IO
  throwIO, called at libraries/exceptions/src/Control/Monad/Catch.hs:371:12 in exceptions-0.10.7-inplace:Control.Monad.Catch
  throwM, called at libraries/exceptions/src/Control/Monad/Catch.hs:860:84 in exceptions-0.10.7-inplace:Control.Monad.Catch
  onException, called at compiler/GHC/Driver/Make.hs:2981:23 in ghc-9.10.1-inplace:GHC.Driver.Make

After apk add gmp-static:

ghc -static -optl-pthread -optl-static Main.hs

[1 of 2] Compiling Main             ( Main.hs, Main.o )
[2 of 2] Linking Main

---

ldd Main

/lib/ld-musl-aarch64.so.1: Main: Not a valid dynamic program

---

file Main

Main: ELF 64-bit LSB executable, ARM aarch64, version 1 (SYSV), statically linked, BuildID[sha1]=d7d8a057a8076bbb4876588ffd3ae7b1926a0caf, with debug_info, not stripped

---

UPDATE: This only worked because ld.bfd was used in the regular images [using gmp big-integer implementation]: https://github.com/benz0li/ghc-musl/blob/dd801c1966902e1cac20db228a5fd1110cb8692c/dockerfiles/9.10.1.Dockerfile#L171-L175