ROOT 6.26/04 fails to build with LLVM/Clang 14.0.6 with C++17 / `libc++` on SLF7

[greenc-FNAL]

• Checked for duplicates

Describe the bug

ROOT 6.26/04 (https://github.com/root-project/root/tree/02b2af7af1be3430a3124236a7cdc6bb13cf90d2) fails to build with LLVM/Clang 14.0.6 with the following error from rootcling:

[7221/9777] Generating G__Core.cxx, ../lib/Core.pcm
FAILED: core/G__Core.cxx lib/Core.pcm ...
<snip/>
rootcling_stage1: /scratch/greenc/test-products/root/v6_26_04/source/root-6.26.04/interpreter/llvm/src/tools/clang/lib/Serialization/ASTWriter.cpp:2799: unsigned int clang::ASTWriter::getSubmoduleID(clang::Module *): Assertion `(ID || !Mod) && "asked for module ID for non-local, non-imported module"' failed.
 #0 0x0000000003ee5514 PrintStackTraceSignalHandler(void*) Signals.cpp:0:0
 #1 0x0000000003ee32cc llvm::sys::RunSignalHandlers() Signals.cpp:0:0
 #2 0x0000000003ee5935 SignalHandler(int) Signals.cpp:0:0
 #3 0x00007f1552225630 __restore_rt sigaction.c:0:0
 #4 0x00007f1551316387 raise (/lib64/libc.so.6+0x36387)
 #5 0x00007f1551317a78 abort (/lib64/libc.so.6+0x37a78)
 #6 0x00007f155130f1a6 __assert_fail_base (/lib64/libc.so.6+0x2f1a6)
 #7 0x00007f155130f252 (/lib64/libc.so.6+0x2f252)
 #8 0x0000000001d23bf3 clang::ASTWriter::WriteSubmodules(clang::Module*) ASTWriter.cpp:0:0
 #9 0x0000000001d34a01 clang::ASTWriter::WriteASTCore(clang::Sema&, llvm::StringRef, std::__2::basic_string<char, std::__2::char_traits<char>, std::__2::allocator<char> > const&, clang::Module*) ASTWriter.cpp:0:0
#10 0x0000000001d31700 clang::ASTWriter::WriteAST(clang::Sema&, std::__2::basic_string<char, std::__2::char_traits<char>, std::__2::allocator<char> > const&, clang::Module*, llvm::StringRef, bool, bool) ASTWriter.cpp:0:0
#11 0x0000000001d7f347 clang::PCHGenerator::HandleTranslationUnit(clang::ASTContext&) GeneratePCH.cpp:0:0
#12 0x0000000001a4269c clang::MultiplexConsumer::HandleTranslationUnit(clang::ASTContext&) MultiplexConsumer.cpp:0:0
#13 0x0000000001ba6284 clang::ParseAST(clang::Sema&, bool, bool) ParseAST.cpp:0:0
#14 0x00000000019f9690 clang::FrontendAction::Execute() FrontendAction.cpp:0:0
#15 0x00000000019a4939 clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) CompilerInstance.cpp:0:0
#16 0x00000000019afbe2 void llvm::function_ref<void ()>::callback_fn<compileModuleImpl(clang::CompilerInstance&, clang::SourceLocation, llvm::StringRef, clang::FrontendInputFile, llvm::StringRef, llvm::StringRef, llvm::function_ref<void (clang::CompilerInstance&)>, llvm:::function_ref<void (clang::CompilerInstance&)>)::$_3>(long) CompilerInstance.cpp:0:0
#17 0x0000000003e4378f llvm::CrashRecoveryContext::RunSafely(llvm::function_ref<void ()>) CrashRecoveryContext.cpp:0:0
#18 0x0000000003e438b4 RunSafelyOnThread_Dispatch(void*) CrashRecoveryContext.cpp:0:0
#19 0x0000000003e4388d llvm::CrashRecoveryContext::RunSafelyOnThread(llvm::function_ref<void ()>, unsigned int) CrashRecoveryContext.cpp:0:0
#20 0x00000000019ac171 compileModuleImpl(clang::CompilerInstance&, clang::SourceLocation, llvm::StringRef, clang::FrontendInputFile, llvm::StringRef, llvm::StringRef, llvm::function_ref<void (clang::CompilerInstance&)>, llvm::function_ref<void (clang::CompilerInstance&)>) CompilerInstance.cpp:0:0
#21 0x00000000019aa3b1 compileAndLoadModule(clang::CompilerInstance&, clang::SourceLocation, clang::SourceLocation, clang::Module*, llvm::StringRef) CompilerInstance.cpp:0:0
#22 0x00000000019a964a clang::CompilerInstance::loadModule(clang::SourceLocation, llvm::ArrayRef<std::__2::pair<clang::IdentifierInfo*, clang::SourceLocation> >, clang::Module::NameVisibilityKind, bool) CompilerInstance.cpp:0:0
#23 0x0000000003b2a5be clang::Preprocessor::HandleHeaderIncludeOrImport(clang::SourceLocation, clang::Token&, clang::Token&, clang::SourceLocation, clang::DirectoryLookup const*, clang::FileEntry const*) PPDirectives.cpp:0:0
#24 0x0000000003b221d5 clang::Preprocessor::HandleIncludeDirective(clang::SourceLocation, clang::Token&, clang::DirectoryLookup const*, clang::FileEntry const*) PPDirectives.cpp:0:0
#25 0x0000000003b22b03 clang::Preprocessor::HandleDirective(clang::Token&) PPDirectives.cpp:0:0
#26 0x0000000003afa515 clang::Lexer::LexTokenInternal(clang::Token&, bool) Lexer.cpp:0:0
#27 0x0000000003af7b42 clang::Lexer::Lex(clang::Token&) Lexer.cpp:0:0
#28 0x0000000003b5a264 clang::Preprocessor::Lex(clang::Token&) Preprocessor.cpp:0:0
#29 0x0000000001c40f00 clang::Parser::ParseTopLevelDecl(clang::OpaquePtr<clang::DeclGroupRef>&, bool) Parser.cpp:0:0
#30 0x000000000152a89e cling::IncrementalParser::ParseInternal(llvm::StringRef) IncrementalParser.cpp:0:0
#31 0x0000000001529c34 cling::IncrementalParser::Initialize(llvm::SmallVectorImpl<llvm::PointerIntPair<cling::Transaction*, 2u, cling::IncrementalParser::EParseResult, llvm::PointerLikeTypeTraits<cling::Transaction*>, llvm::PointerIntPairInfo<cling::Transaction*, 2u, llvm::PointerLikeTypeTraits<cling::Transaction*> > > >&, bool) IncrementalParser.cpp:0:0
#32 0x000000000151d992 cling::Interpreter::Interpreter(int, char const* const*, char const*, std::__2::vector<std::__2::shared_ptr<clang::ModuleFileExtension>, std::__2::allocator<std::__2::shared_ptr<clang::ModuleFileExtension> > > const&, bool, cling::Interpreter const*) Interpreter.cpp:0:0
#33 0x00000000014a5117 std::__2::vector<std::__2::shared_ptr<clang::ModuleFileExtension>, std::__2::allocator<std::__2::shared_ptr<clang::ModuleFileExtension> > >::~vector() /scratch/greenc/test-products/clang/v14_0_6b/Linux64bit+3.10-2.17/bin/../include/c++/v1/vector:399:17
#34 0x00000000014a5117 RootClingMain(int, char**, bool) /scratch/greenc/test-products/root/v6_26_04/source/root-6.26.04/core/dictgen/src/rootcling_impl.cxx:4315:7
#35 0x00000000014b2135 ROOT_rootcling_Driver /scratch/greenc/test-products/root/v6_26_04/source/root-6.26.04/core/dictgen/src/rootcling_impl.cxx:0:16
#36 0x00000000014f6b7e main /scratch/greenc/test-products/root/v6_26_04/source/root-6.26.04/core/rootcling_stage1/src/rootcling_stage1.cxx:46:4
#37 0x00007f1551302555 __libc_start_main (/lib64/libc.so.6+0x22555)
#38 0x000000000143eb89 _start (/scratch/greenc/test-products/root/v6_26_04/build/Linux64bit+3.10-2.17-c13-p3912-prof/core/rootcling_stage1/src/rootcling_stage1+0x143eb89)
<snip/>

Expected behavior

Successful build.

To Reproduce

Attempt to build ROOT with LLVM/Clang 14.0.6 and C++17 / libc++ (precise configuration should be irrelevant provided runtime_cxxmodules is ON).

Additional context

This was a second, simplified attempt after rootcling failed to find PSTL headers (e.g. __pstl_memory) in <clang-lib>/clang/14.0.6/include during the ROOT build when LLVM/Clang was compiled with parallel algorithms enabled in libc++.

Currently attempting to reproduce on master branch.

Fail with identical error on master (https://github.com/root-project/root/tree/7b7983fa8ab9e1a4af98776f7f80bea1f9b2b0b0).

[Axel-Naumann]

Is there any chance to get the backtrace with some more debug info from the llvm side, by adding -DLLVM_BUILD_TYPE=Debug to ROOT's configuration?

[greenc-FNAL]

Should be relatively straightforward. Working on it now.

[Axel-Naumann]

Sorry for the slow response from me! To make things worse, it's highly asymmetrical: thanks for your super fast reaction :-)

[greenc-FNAL]

I'm on vacation for the next week, but I'll try to provide whatever extra information you can tell me you need today ASAP. Log file with LLVM_DEBUG attached as
build-root-6.26.04b-sl7-x86_64-c14-p3912-debug-runtime_cxxmodules-llvm_debug.log