clang64 flang compile failure

[bmiyuan]

it works fine when I use mingw64 to compile openblas on windows, but it compiles failure when I use clang64 flang with Ninja generator .

I try to fix the issue, and add the FC environment variable, it can build successfully, but it seems the lapack isn't compiled. the prebuild log also shows the info :
-- Looking for a Fortran compiler - NOTFOUND
-- No Fortran compiler found, can build only BLAS but not LAPACK

Is threre a solution that can build LAPACK successfully on windows with clang64 ? thanks in advance!

[martin-frbg]

Not sure why it did not identify the clang64 version of flang - we rely on the standard "CheckLanguage" module of cmake (called in cmake/f_check,cmake as check_language(Fortran)). Perhaps cmake failed to link the small test program it tries to compile, or the flang command itself was not available in the system path ? (There may be some information in the CMakeFiles\CMakeError.log and/or CMakeFiles\CMakeOutput.log under your build directory)
As an alternative to setting FC, I guess you could try specifiying the -DCMAKE_Fortran_COMPILER=/path/to/your/flang option to cmake

[bmiyuan]

Hi,Martin
thanks your advise, but it still failed.
Build failure Infor:

-- The ASM compiler identification is Clang
-- Found assembler: C:/msys64/clang64/bin/clang.exe
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: C:/msys64/clang64/bin/clang.exe - skipped
-- Detecting C compile features
-- Detecting C compile features - done
CMake Warning at CMakeLists.txt:90 (message):
CMake support is experimental. It does not yet support all build options
and may not produce the same Makefiles that OpenBLAS ships with.

-- Looking for stdatomic.h
-- Looking for stdatomic.h - found
-- GEMM multithread threshold set to 4.
-- Multi-threading enabled with 12 threads.
-- The Fortran compiler identification is unknown
error: unknown integrated tool '-cc1'. Valid tools include '-fc1'.
-- Detecting Fortran compiler ABI info
CMake Error: Error required internal CMake variable not set, cmake may not be built correctly.
Missing variable is:
CMAKE_Fortran_PREPROCESS_SOURCE
CMake Error at C:/Program Files/JetBrains/CLion 2021.1.1/bin/cmake/win/share/cmake-3.19/Modules/CMakeDetermineCompilerABI.cmake:48 (try_compile):
Failed to generate test project build system.
Call Stack (most recent call first):
C:/Program Files/JetBrains/CLion 2021.1.1/bin/cmake/win/share/cmake-3.19/Modules/CMakeTestFortranCompiler.cmake:20 (CMAKE_DETERMINE_COMPILER_ABI)
cmake/f_check.cmake:27 (enable_language)
cmake/prebuild.cmake:89 (include)
cmake/system.cmake:163 (include)
CMakeLists.txt:93 (include)

Detailed CMakeError log info:
Checking whether the ASM compiler is GNU using "--version" did not match "(GNU assembler)|(GCC)|(Free Software Foundation)":
clang version 13.0.0
Target: x86_64-w64-windows-gnu
Thread model: posix
InstalledDir: C:/msys64/clang64/bin
Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/flang-new.exe
Build flags:
Id flags: -v

The output was:
1
flang-new version 13.0.0
Target: x86_64-w64-windows-gnu
Thread model: posix
InstalledDir: C:/msys64/clang64/bin
"C:/msys64/clang64/bin/flang-new" -fc1 -emit-obj -o C:/Users/XT/AppData/Local/Temp/CMakeFortranCompilerId-22f181.o CMakeFortranCompilerId.F
error: code-generation is not available yet

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/flang-new.exe
Build flags:
Id flags:

The output was:
1
error: code-generation is not available yet

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/flang-new.exe
Build flags:
Id flags: -c

The output was:
1
error: code-generation is not available yet

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/flang-new.exe
Build flags:
Id flags: -fpp

The output was:
1
flang-new: error: unknown argument: '-fpp'

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/flang-new.exe
Build flags:
Id flags: -v

The output was:
1
flang-new version 13.0.0
Target: x86_64-w64-windows-gnu
Thread model: posix
InstalledDir: C:/msys64/clang64/bin
"C:/msys64/clang64/bin/flang-new" -fc1 -emit-obj -o C:/Users/XT/AppData/Local/Temp/CMakeFortranCompilerId-f417fc.o CMakeFortranCompilerId.F
error: code-generation is not available yet

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/flang-new.exe
Build flags:
Id flags:

The output was:
1
error: code-generation is not available yet

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/flang-new.exe
Build flags:
Id flags: -c

The output was:
1
error: code-generation is not available yet

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/flang-new.exe
Build flags:
Id flags: -fpp

The output was:
1
flang-new: error: unknown argument: '-fpp'

Checking whether the Fortran compiler is Compaq using "-what" did not match "Compaq Visual Fortran":
flang-new: error: unknown argument: '-what'
flang-new: error: no input files
Checking whether the Fortran compiler is NAG using "-V" did not match "NAG Fortran Compiler":
flang-new: error: argument to '-V' is missing (expected 1 value)
flang-new: error: no input files
Checking whether the Fortran compiler is Compaq using "-what" did not match "Compaq Visual Fortran":
flang-new: error: unknown argument: '-what'
flang-new: error: no input files
Checking whether the Fortran compiler is NAG using "-V" did not match "NAG Fortran Compiler":
flang-new: error: argument to '-V' is missing (expected 1 value)
flang-new: error: no input files

[bmiyuan]

it seems flang-new.exe lack cc1 tool, so I use f18,but it still failed
C:\msys64\clang64\bin>flang-new.exe -cc1
error: unknown integrated tool '-cc1'. Valid tools include '-fc1'.

C:\msys64\clang64\bin>f18.exe -cc1
Enter Fortran source
Use EOF character (^D) to end file

OutPut compile info:
-- The Fortran compiler identification is unknown
C:/msys64/mingw64/bin/../lib/gcc/x86_64-w64-mingw32/10.3.0/../../../../x86_64-w64-mingw32/bin/ld.exe: C:/msys64/mingw64/bin/../lib/gcc/x86_64-w64-mingw32/10.3.0/../../../../x86_64-w64-mingw32/lib/../lib/libmingw32.a(lib64_libmingw32_a-crt0_c.o): in function main': C:/_/M/mingw-w64-crt-git/src/mingw-w64/mingw-w64-crt/crt/crt0_c.c:18: undefined reference to WinMain'
collect2.exe: error: ld returned 1 exit status
execvp(gfortran) failed:
-- Detecting Fortran compiler ABI info
CMake Error: Error required internal CMake variable not set, cmake may not be built correctly.
Missing variable is:
CMAKE_Fortran_PREPROCESS_SOURCE
CMake Error at C:/Program Files/JetBrains/CLion 2021.1.1/bin/cmake/win/share/cmake-3.19/Modules/CMakeDetermineCompilerABI.cmake:48 (try_compile):
Failed to generate test project build system.
Call Stack (most recent call first):
C:/Program Files/JetBrains/CLion 2021.1.1/bin/cmake/win/share/cmake-3.19/Modules/CMakeTestFortranCompiler.cmake:20 (CMAKE_DETERMINE_COMPILER_ABI)
cmake/f_check.cmake:27 (enable_language)
cmake/prebuild.cmake:89 (include)
cmake/system.cmake:163 (include)
CMakeLists.txt:93 (include)

CMAKE error log:
Checking whether the ASM compiler is GNU using "--version" did not match "(GNU assembler)|(GCC)|(Free Software Foundation)":
clang version 13.0.0
Target: x86_64-w64-windows-gnu
Thread model: posix
InstalledDir: C:/msys64/clang64/bin
Compilation of the Fortran compiler identification source "CMakeFortranCompilerId.F" did not produce an executable in "D:/code/OpenBLAS/cmake-build-debug/CMakeFiles/3.19.2/CompilerIdFortran".

The Fortran compiler identification could not be found in "D:/code/OpenBLAS/cmake-build-debug/CMakeFiles/3.19.2/CompilerIdFortran/a.exe"

The Fortran compiler identification could not be found in "D:/code/OpenBLAS/cmake-build-debug/CMakeFiles/3.19.2/CompilerIdFortran/CMakeFortranCompilerId.o"

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/f18.exe
Build flags:
Id flags: -fpp

The output was:
1
gfortran: error: unrecognized command-line option '-fpp'; did you mean '-cpp'?
execvp(gfortran) failed:

Compilation of the Fortran compiler identification source "CMakeFortranCompilerId.F" did not produce an executable in "D:/code/ OpenBLAS/cmake-build-debug/CMakeFiles/3.19.2/CompilerIdFortran".

The Fortran compiler identification could not be found in "D:/code/OpenBLAS/cmake-build-debug/CMakeFiles/3.19.2/CompilerIdFortran/a.exe"

The Fortran compiler identification could not be found in "D:/code/OpenBLAS/cmake-build-debug/CMakeFiles/3.19.2/CompilerIdFortran/CMakeFortranCompilerId.o"

Compiling the Fortran compiler identification source file "CMakeFortranCompilerId.F" failed.
Compiler: C:/msys64/clang64/bin/f18.exe
Build flags:
Id flags: -fpp

The output was:
1
gfortran: error: unrecognized command-line option '-fpp'; did you mean '-cpp'?
execvp(gfortran) failed:

Checking whether the Fortran compiler is Compaq using "-what" terminated after 10 s due to timeout.Checking whether the Fortran compiler is NAG using "-V" did not match "NAG Fortran Compiler":

f18 compiler (under development), version 13.0.0
Checking whether the Fortran compiler is Compaq using "-what" terminated after 10 s due to timeout.Checking whether the Fortran compiler is NAG using "-V" did not match "NAG Fortran Compiler":

f18 compiler (under development), version 13.0.0

[bmiyuan]

Thanks a lot MehdiChinoune ! As you said , CMake dosen't support Clang64 Flang ,so we can't compile lapack of openblas on windows by this way. Is there any other solution we can compile lapack of openblas successfully on windows?

[bmiyuan]

thanks MehdiChinoune ! yes, mingw64 is ok I've already tried before. But our project need use clang64......

[bmiyuan]

Hi,MehdiChinoune
actually,we need Clang compiler and Clang64 environment both.

[martin-frbg]

Building flang (-classic) from source used to be fairly straightforward on Linux, but i have no idea if it would be as easy on Windows. As far as I know, the llvm-related commercial compilers (nvidia hpc, amd aocc) are not available for Windows.

[bmiyuan]

If you need just Clang compiler you could use the clang compiler from MINGW64/UCRT64 + OpenBLAS. If you just need the LAPACK package on CLANG64 then you could install mingw-w64-clang-x86_64-f2cblaslapack, but It is very slow compared to OpenBLAS. Out of curiosity, why exactly do you need CLANG64?

MehdiChinoune, we need compile openblas with LAPACK, bcos we need compile Armadillo,which will calculate data very quickly with openblas, but openblas also depends LAPACK to calculate some data.our project use Clang to compile all the modules and third party libs, and we can't use mingw64 to compile openblas.

[bmiyuan]

Building flang (-classic) from source used to be fairly straightforward on Linux, but i have no idea if it would be as easy on Windows. As far as I know, the llvm-related commercial compilers (nvidia hpc, amd aocc) are not available for Windows.

thanks Martin, but we don't select commercial compilers ,it's better if we can use opensource compiler.
so per your advise, maybe we can try build flang/classic from source on windows, and then use it as the flang compiler when compiler LAPACK of openblas.

[brada4]

Flang is not yet able to generate LLVM IR for the source code and thus is unable to compile a running binary

i.e it is a wrapper for gfrotran or a commercial compiler.

SOURCE: https://releases.llvm.org/13.0.0/tools/flang/docs/ReleaseNotes.html

[carlkl]

@bmiyuan, if you work with the msys2 clang64 environent you can try to use mingw-w64-clang-x86_64-f2cblaslapack. It provides you with two static libraries:

1. /clang64/lib/libblas.a and
2. /clang64/lib/liblapack.a

You can try the latter library (/clang64/lib/liblapack.a) in addition to your locally build OpenBLAS.

The reason why f2cblaslapack was added to msys2 is described here: msys2/MINGW-packages#10386 (comment)

BTW: clang64 provides you with mingw-w64-clang-x86_64-armadillo which depends on mingw-w64-clang-x86_64-openblas.

The clang64 version of OpenBLAS is compiled without LAPACK and LAPACKE support. AFAIK this is not needed for Armadillo anyway.

[brada4]

One can use binary cross-built on Linux with Armadillo, or use clang and gfortran, much like the only free option OSX users have. CMake says you dont have fortran compiler - indeed flang without gfortran is no fortran compiler.

[martin-frbg]

@carlkl if this is based on f2c mangling the netlib Reference-LAPACK sources to C, apart from performance issues it is likely to be a LAPACK version from ten or more years ago (given that f2c does not support fortran95 or later language elements AFAIK).

[brada4]

@martin-frbg probably latest version that did away with f2c....

I thing OP thinks he talks with @MehdiChinoune from
https://github.com/msys2/MINGW-packages/blob/master/mingw-w64-f2cblaslapack/PKGBUILD
fame, who could sched some light on that project's state.

[carlkl]

PKGBUILD uses the latest version from PETCS: https://ftp.mcs.anl.gov/pub/petsc/externalpackages/f2cblaslapack-3.4.2.q4.tar.gz (2020). However, Lapack version 3.4.2 is from 2012.
The interesting question is (CLANG64): can we use the accelerated BLAS part from OpenBLAS and Lapack from f2cblaslapack?