.NET 7: Alpine 3.17 package issue tracker

[ayakael]

Issue tracker for Alpine 3.17

Goals

1. Prepare .NET 7.0 for Alpine 3.17 (x64, arm64, arm)
2. Work towards targetting x86, armv6, s390x, ppc64le

Steps for 1.

• runtime: Add RIDs for Alpine 3.17 (Add RID for alpine-3.17 + alpine-{armv6,x86,s390x,ppc64le} runtime#75396)
• runtime: Extremly slow build of runtime in non-portable mode on arm ([v7.0.0-rc.1.22426.10] Extremely slow build of non-portable runtime on armv7 runtime#75811)
• installer: Add arm support ([release/6.0.1xx] Arm support installer#13378)
• installer: Confirm MicrosoftAspNetCoreAppRuntimePackageVersion is remembered along the way ([release/7.0.1xx] Wrong version of aspnetcore.runtime.internal is pulled by GenerateLayout #3121)
• installer: Add musl support (Eliminate portable runtime build. installer#14549)

Steps for 2.

• runtime: Add RIDs for x86, armv6, s390x, ppc64le (Add RID for alpine-3.17 + alpine-{armv6,x86,s390x,ppc64le} runtime#75396)
• runtime: Port mono to musl (Mono musl support runtime#76500)
• all: port to s390x([Alpine Linux] s390x platform support #2839)
• all: explore feasability of ppc64le port

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

[ayakael]

@omajid
In trying to build current release/7.0.1xx-rc1 of source-build-reference-packages, I get this error:

    /var/build/dotnet7/testing/dotnet7-stage0/src/dotnet-v7.0.1xx-rc1/src/source-build-reference-packages/artifacts/source-build/self/src/src/targetPacks/Directory.Build.targets(108,5): error : Package runtime.linux-musl-x64.microsoft.netcore.ilasm\7.0.0-rc.1.22403.8 was not restored

runtime.linux-musl-x64.Microsoft.NETCore.ILAsm.7.0.0-rc.1.22411.12.nupkg was built via ./build.sh -arch x64 -c Release -clang /p:NoPgoOptimize=true /p:EnableNgenOptimization=false /p:VersionSuffix=rc.1.22411.12.

Any idea what might be causing this error?

[omajid]

Sorry, I don't have a good idea. The various release/7.0.1xx* branches are broken for me too at the moment, in various different ways, mostly complaining about error : Unable to find package Microsoft.DotNet.Arcade.Sdk with version (= 7.0.0-beta.22403.1). Maybe try this again in a day or so, hoping upstream has fixed these issues?

[ayakael]

Unrelated, but currently backporting various patches for release/6.0.1xx:

• installer: Fix for portable runtme id ([release/6.0.1xx] GetRuntimeInformation.targets: determine PortableProductMonikerRid based on OSName and Architecture. (backports #12516) installer#14477)
• runtime: deprecate icu ucol-safeclone ([release/6.0] Bump the macOS image to one that isn't EOL yet runtime#75294)
• runtime: detect armv8 ([release/6.0] Add armv8l virtualized 32-bit ARM core detection (backports #66477) runtime#75528)
• runtime: musl 1.2.3 support ([release/6.0] Fix build for musl 1.2.3 (backports #67772) runtime#75529)
• runtime: Alpine 3.17 RIDs ([release/6.0] Add RID for alpine-3.17 + alpine-{x86,s390x} (backports #75396) runtime#75530)
• runtime: Workaround for build with clang-14 ([release/6.0] Workaround for building with clang-14 (backports #74696) runtime#75526)
• sdk: portable runtime id fix ([release/6.0.1xx] Use the portable rid for --use-current-runtime (backports #21748) sdk#27849)

[ayakael]

Sorry, I don't have a good idea. The various release/7.0.1xx* branches are broken for me too at the moment, in various different ways, mostly complaining about error : Unable to find package Microsoft.DotNet.Arcade.Sdk with version (= 7.0.0-beta.22403.1). Maybe try this again in a day or so, hoping upstream has fixed these issues?

Copy that. Should I wait till rc1 is released proper?

[omajid]

Copy that. Should I wait till rc1 is properly released?

I was just told that this should all be working. Probably a good idea to file issues. I am going to do that for the arcade issues I mentioned above.

[ayakael]

Does this build error in sdk ring any bells for you?

/var/build/aports/main/dotnet6-cross/src/dotnet-8a0eb58a5a825e10ea2bf06a892dd441355818c8/src/sdk/src/Cli/Microsoft.DotNet.Cli.Utils/Microsoft.DotNet.Cli.Utils.csproj(27,5): error : Something moved around in Microsoft.Build.Runtime, adjust code here accordingly.
CSC : error CS2008: No source files specified. [/var/build/aports/main/dotnet6-cross/src/dotnet-8a0eb58a5a825e10ea2bf06a892dd441355818c8/src/sdk/template_feed/Microsoft.DotNet.Common.ItemTemplates/Microsoft.DotNet.Common.ItemTemplates.csproj]
CSC : error CS2008: No source files specified. [/var/build/aports/main/dotnet6-cross/src/dotnet-8a0eb58a5a825e10ea2bf06a892dd441355818c8/src/sdk/template_feed/Microsoft.DotNet.Common.ProjectTemplates.7.0/Microsoft.DotNet.Common.ProjectTemplates.7.0.csproj]
    0 Warning(s)
    3 Error(s)

It occurs in current release/7.0.1xx, but not in release/7.0.1xx-rc1

[ayakael]

What is a good space to share issues on dotnet/llvm-project? I'm encountering problems crossbuilding to arm64 / armv7 from x64 via

CLANG_TARGET=$CHOST ROOTFS_DIR="$CBUILDROOT" ./eng/build.sh -c Release -arch arm64 -clang -cross --restore --build --pack /p:VersionSuffix=alpha.1.22411.1 /p:OSRid=linux-musl

This is after forcing use of clang-14.

Error:

  [ 73%] Building IntrinsicsHexagon.h...
  [ 73%] Building IntrinsicsR600.h...
  ../../../bin/llvm-tblgen: ../../../bin/llvm-tblgen: line 1: line 1: �ELF�4g@�8@8: not found�ELF�4g@�8@8: not found
  
  ../../../bin/llvm-tblgen: line 1: �ELF�4g@�8@8: not found
  [ 73%] Building IntrinsicsMips.h...
  [ 73%] Building IntrinsicsPowerPC.h...
  [ 73%] Building IntrinsicsNVPTX.h...
  ../../../bin/llvm-tblgen: ../../../bin/llvm-tblgen: line 10: line 10: syntax error: unexpected "(" (expecting ")")syntax error: unexpected "(" (expecting ")")
  
  ../../../bin/llvm-tblgen: ../../../bin/llvm-tblgen: line 10: line 1: syntax error: unexpected "(" (expecting ")")�ELF�4g@�8@8: not found
  
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:148: include/llvm/IR/Attributes.inc] Error 2
  make[3]: *** Waiting for unfinished jobs....
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:272: include/llvm/IR/IntrinsicImpl.inc] Error 2
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:210: include/llvm/IR/IntrinsicEnums.inc] Error 2
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:334: include/llvm/IR/IntrinsicsAArch64.h] Error 2
  ../../../bin/llvm-tblgen: line 1: �ELF�4g@�8@8: not found
  ../../../bin/llvm-tblgen: line 1: �ELF�4g@�8@8: not found
  ../../../bin/llvm-tblgen: line 1: �ELF�4g@�8@8: not found
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:520: include/llvm/IR/IntrinsicsBPF.h] Error 2
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:582: include/llvm/IR/IntrinsicsHexagon.h] Error 2
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:396: include/llvm/IR/IntrinsicsAMDGPU.h] Error 2
  ../../../bin/llvm-tblgen: ../../../bin/llvm-tblgen: line 1: line 1: �ELF�4g@�8@8: not found�ELF�4g@�8@8: not found
  
  [ 73%] Building IntrinsicsRISCV.h...
  ../../../bin/llvm-tblgen: line 1: �ELF�4g@�8@8: not found
  ../../../bin/llvm-tblgen: line 1: �ELF�4g@�8@8: not found
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:706: include/llvm/IR/IntrinsicsNVPTX.h] Error 2
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  ../../../bin/llvm-tblgen: ../../../bin/llvm-tblgen: line 1: line 10: �ELF�4g@�8@8: not found
  syntax error: unexpected "(" (expecting ")")
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:644: include/llvm/IR/IntrinsicsMips.h] Error 2
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:830: include/llvm/IR/IntrinsicsR600.h] Error 2
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:458: include/llvm/IR/IntrinsicsARM.h] Error 2
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:768: include/llvm/IR/IntrinsicsPowerPC.h] Error 2
  ../../../bin/llvm-tblgen: line 1: �ELF�4g@�8@8: not found
  ../../../bin/llvm-tblgen: line 10: syntax error: unexpected "(" (expecting ")")
  make[3]: *** [include/llvm/IR/CMakeFiles/intrinsics_gen.dir/build.make:892: include/llvm/IR/IntrinsicsRISCV.h] Error 2
  make[2]: *** [CMakeFiles/Makefile2:4991: include/llvm/IR/CMakeFiles/intrinsics_gen.dir/all] Error 2
  make[2]: *** Waiting for unfinished jobs....
  [ 73%] Linking CXX static library ../libLLVMMC.a
  [ 73%] Built target LLVMMC
  make[1]: *** [CMakeFiles/Makefile2:20876: tools/objwriter/CMakeFiles/objwriter.dir/rule] Error 2
  make: *** [Makefile:7079: objwriter] Error 2
/var/build/aports/main/dotnet6-cross/src/llvm-project-c1304304028d603e34f6803b0740c34441f80d2e/llvm.proj(98,5): error MSB3073: The command " make objwriter llvm-mca FileCheck -j36" exited with code 2.

Build FAILED.

/var/build/aports/main/dotnet6-cross/src/llvm-project-c1304304028d603e34f6803b0740c34441f80d2e/llvm.proj(98,5): error MSB3073: The command " make objwriter llvm-mca FileCheck -j36" exited with code 2.
    0 Warning(s)
    1 Error(s)

This is likely caused by bin/llvm-tblge being built for arm64, build ought to compile and use a native x64 version.

[ayakael]

@omajid Alpine aport for dotnet7 rc1 is implemented here, and it sems to build: https://gitlab.alpinelinux.org/alpine/aports/-/merge_requests/39122

[ayakael]

@omajid Build on armv7 takes 4x longer than aarch64 due to a strange bug with non-portable building of runtime. Would you have any hypotheses that could explain why portable build of runtime takes 20 minutes but non-portable takes 6 hours?

edit: I opened a runtime issue for this: dotnet/runtime#75811