OOM when compiling OpenCL kernel at runtime

[pranav-sivaraman]

I'm currently running the Hashcat application in benchmark mode with the Intel OpenCL runtime. One of the kernels in the benchmark is causing the application to run out of memory (OOM).

When attaching to the process with GDB, I see that there are infinite calls to malloc during the kernel compilation process.

Build the application:

curl -L https://github.com/hashcat/hashcat/archive/refs/tags/v6.2.6.tar.gz | tar xz
cd hashcat-6.2.6 && make -j32

Setup OpenCL runtime

source /nas/sw/sdev/intel/oneapi/2024/v2.1/setvars.sh

Verify that Hashcat detects the OpenCL runtime:

hashcat -I

The output should be similar to this

hashcat (v6.2.6) starting in backend information mode

SYCL CPU RT Warning: Unknown host CPU.
OpenCL Info:
============

OpenCL Platform ID #1
  Vendor..: Intel(R) Corporation
  Name....: Intel(R) OpenCL
  Version.: OpenCL 3.0 LINUX

  Backend Device ID #1
    Type...........: CPU
    Vendor.ID......: 8
    Vendor.........: Intel(R) Corporation
    Name...........: AMD EPYC 9745 128-Core Processor
    Version........: OpenCL 3.0 (Build 0)
    Processor(s)...: 512
    Clock..........: 0
    Memory.Total...: 772978 MB (limited to 193244 MB allocatable in one block)
    Memory.Free....: 386457 MB
    Local.Memory...: 256 KB
    OpenCL.Version.: OpenCL C 3.0
    Driver.Version.: 2024.18.12.0.05_160000

Run the problem benchmark
./hashcat --benchmark -m 1500

Observations:

• The issue occurs in all Intel OpenCL runtimes from version 2023.2 up to the latest 2025.0.4.
• The problem does not occur with the OpenCL runtime version prior to 2023.2.
• I have been able to successfully run this kernel using the POCL runtime, so I am confident that the issue is related to the Intel OpenCL runtime.

Please let me know if any further details are needed to help diagnose the issue.
Thanks!

[JablonskiMateusz]

@pranav-sivaraman
could you share source code of the OpenCL kernel that is causing the issue?

When attaching to the process with GDB, I see that there are infinite calls to malloc during the kernel compilation process.

Could you share callstack of this?

[pranav-sivaraman]

Could you share source code of the OpenCL kernel

This is the source code of the OpenCL kernel. I am currently trying to reduce it.

Could you share callstack of this?

Thread 1 "hashcat" received signal SIGINT, Interrupt.
0x00007fffed298f9d in _int_malloc () from /lib64/libc.so.6
#0  0x00007fffed298f9d in _int_malloc () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fffed299809 in malloc () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007fffc7769669 in operator new(unsigned long) ()
   from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#3  0x00007fffc69d072b in getCartesianProduct(std::__1::vector<std::__1::vector<llvm::VFParameter, std::__1::allocator<llvm::VFParameter> >, std::__1::allocator<std::__1::vector<llvm::VFParameter, std::__1::allocator<llvm::VFParameter> > > >&, std::__1::vector<llvm::VFParameter, std::__1::allocator<llvm::VFParameter> >&, std::__1::vector<std::__1::vector<llvm::VFParameter, std::__1::allocator<llvm::VFParameter> >, std::__1::allocator<std::__1::vector<llvm::VFParameter, std::__1::allocator<llvm::VFParameter> > > >&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#4  0x00007fffc69cfbbb in llvm::vpo::VPlanCallVecDecisions::getVectorVariantsForCallParameters(llvm::vpo::VPCallInstruction const*, bool, int, llvm::SmallVectorImpl<bool>&, llvm::SmallVectorImpl<llvm::VFInfo>&, llvm::TargetTransformInfo const*) ()
   from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#5  0x00007fffc5704a26 in llvm::vpo::VPlanCallVecDecisions::matchVectorVariant(llvm::vpo::VPCallInstruction const*, bool, unsigned int, llvm::TargetTransformInfo const*)
    () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#6  0x00007fffc56feba7 in llvm::vpo::VPlanCallVecDecisions::analyzeCall(llvm::vpo::VPCallInstruction*, unsigned int, llvm::TargetLibraryInfo const*, llvm::TargetTransformInfo const*, bool) ()
   from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#7  0x00007fffc56fe81a in llvm::vpo::VPlanCallVecDecisions::runForVF(unsigned int, llvm::TargetLibraryInfo const*, llvm::TargetTransformInfo const*) ()
   from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#8  0x00007fffc56fe53d in llvm::vpo::VPlanTTICostModel::VPlanTTICostModel(llvm::vpo::VPlanVector const*, unsigned int, unsigned int, llvm::TargetTransformInfo const*, llvm::TargetLibraryInfo const*, llvm::DataLayout const*, llvm::vpo::VPlanVLSAnalysis*, llvm::loopopt::DDGraph const*, llvm::vpo::VPInstructionCost) ()
   from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#9  0x00007fffc6a3ef06 in llvm::vpo::VPlanCostModelWithHeuristics<llvm::vpo::HeuristicsList<llvm::vpo::VPInstruction const>, llvm::vpo::HeuristicsList<llvm::vpo::VPBasicBlock const>, llvm::vpo::HeuristicsList<llvm::vpo::VPlanVector const, llvm::vpo::VPlanCostModelHeuristics::HeuristicSLP, llvm::vpo::VPlanCostModelHeuristics::HeuristicSpillFill, llvm::vpo::VPlanCostModelHeuristics::HeuristicUnroll> >::VPlanCostModelWithHeuristics(llvm::vpo::VPlanVector const*, unsigned int, unsigned int, llvm::TargetTransformInfo const*, llvm::TargetLibraryInfo const*, llvm::DataLayout const*, llvm::vpo::VPlanVLSAnalysis*, llvm::loopopt::DDGraph const*, llvm::vpo::VPInstructionCost) ()
   from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#10 0x00007fffc5aed53f in llvm::vpo::VPlanCostModelWithHeuristics<llvm::vpo::HeuristicsList<llvm::vpo::VPInstruction const>, llvm::vpo::HeuristicsList<llvm::vpo::VPBasicBlock const>, llvm::vpo::HeuristicsList<llvm::vpo::VPlanVector const, llvm::vpo::VPlanCostModelHeuristics::HeuristicSLP, llvm::vpo::VPlanCostModelHeuristics::HeuristicSpillFill, llvm::vpo::VPlanCostModelHeuristics::HeuristicUnroll> >::makeUniquePtr(llvm::vpo::VPlanVector const*, unsigned int, unsigned int, llvm::TargetTransformInfo const*, llvm::TargetLibraryInfo const*, llvm::DataLayout const*, llvm::vpo::VPlanVLSAnalysis*, llvm::loopopt::DDGraph const*, llvm::vpo::VPInstructionCost) ()
   from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#11 0x00007fffc56fe262 in llvm::vpo::VPlanner::createCostModel(llvm::vpo::VPlanVector const*, unsigned int, unsigned int) const () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#12 0x00007fffc56f6b56 in llvm::vpo::VPlanner::selectBestPeelingVariants() () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#13 0x00007fffc56f54be in llvm::vpo::VPlanner::selectBestPlan() () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#14 0x00007fffc5862574 in llvm::vpo::DriverImpl::processLoop(llvm::PointerUnion<llvm::Loop*, llvm::loopopt::HLLoop*>, llvm::Function&, llvm::vpo::WRNVecLoopNode*) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#15 0x00007fffc6a0ddfe in llvm::vpo::DriverLLVMImpl::adjustAndProcessLoop(llvm::Function&, llvm::vpo::DriverImpl::LoopToVectorize) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#16 0x00007fffc506b1ec in llvm::vpo::DriverImpl::runStandardMode(llvm::Function&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#17 0x00007fffc52de91e in llvm::vpo::DriverLLVMImpl::runImpl(llvm::Function&, llvm::LoopInfo*, llvm::ScalarEvolution*, llvm::DominatorTree*, llvm::AssumptionCache*, llvm::AAResults*, llvm::DemandedBits*, llvm::LoopAccessInfoManager*, llvm::OptimizationRemarkEmitter*, llvm::vpo::WRegionInfo*, llvm::TargetTransformInfo*, llvm::TargetLibraryInfo*, llvm::BlockFrequencyInfo*, llvm::ProfileSummaryInfo*, std::__1::function<void (llvm::Function*, llvm::vpo::VecErrorKind)>) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#18 0x00007fffc4ed2a8a in llvm::vpo::VPlanDriverLLVMPass::run(llvm::Function&, llvm::AnalysisManager<llvm::Function>&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#19 0x00007fffc4ed2851 in llvm::detail::PassModel<llvm::Function, llvm::vpo::VPlanDriverLLVMPass, llvm::AnalysisManager<llvm::Function>>::run(llvm::Function&, llvm::AnalysisManager<llvm::Function>&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#20 0x00007fffc4ff7038 in llvm::PassManager<llvm::Function, llvm::AnalysisManager<llvm::Function>>::run(llvm::Function&, llvm::AnalysisManager<llvm::Function>&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#21 0x00007fffc4ff6d71 in llvm::detail::PassModel<llvm::Function, llvm::PassManager<llvm::Function, llvm::AnalysisManager<llvm::Function>>, llvm::AnalysisManager<llvm::Function>>::run(llvm::Function&, llvm::AnalysisManager<llvm::Function>&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#22 0x00007fffc5061c45 in llvm::ModuleToFunctionPassAdaptor::run(llvm::Module&, llvm::AnalysisManager<llvm::Module>&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#23 0x00007fffc5061a21 in llvm::detail::PassModel<llvm::Module, llvm::ModuleToFunctionPassAdaptor, llvm::AnalysisManager<llvm::Module>>::run(llvm::Module&, llvm::AnalysisManager<llvm::Module>&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#24 0x00007fffc4ffc53a in llvm::PassManager<llvm::Module, llvm::AnalysisManager<llvm::Module>>::run(llvm::Module&, llvm::AnalysisManager<llvm::Module>&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#25 0x00007fffc5ee6376 in Intel::OpenCL::DeviceBackend::OptimizerLTO::Optimize(llvm::raw_ostream&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#26 0x00007fffc5d44e65 in Intel::OpenCL::DeviceBackend::Compiler::BuildProgram(llvm::Module*, char const*, Intel::OpenCL::DeviceBackend::ProgramBuildResult*, std::__1::unique_ptr<llvm::TargetMachine, std::__1::default_delete<llvm::TargetMachine> >&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#27 0x00007fffc5e2e2a6 in Intel::OpenCL::DeviceBackend::ProgramBuilder::BuildProgram(Intel::OpenCL::DeviceBackend::Program*, Intel::OpenCL::DeviceBackend::ICLDevBackendOptions const*, char const*) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#28 0x00007fffc5e210a7 in Intel::OpenCL::DeviceBackend::CompileService::BuildProgram(Intel::OpenCL::DeviceBackend::ICLDevBackendProgram_*, Intel::OpenCL::DeviceBackend::ICLDevBackendOptions const*, char const*) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#29 0x00007fffc5d10950 in Intel::OpenCL::CPUDevice::ProgramService::BuildProgram(void*, char const*, int*) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#30 0x00007fffc5c7cdd4 in Intel::OpenCL::Framework::DeviceBuildTask::Execute() () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#31 0x00007fffc5c7cf51 in non-virtual thunk to Intel::OpenCL::Framework::DeviceBuildTask::Execute() () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#32 0x00007fffc5d1db11 in Intel::OpenCL::TaskExecutor::execute_command(Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::TaskExecutor::ITaskBase> const&, Intel::OpenCL::TaskExecutor::base_command_list&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#33 0x00007fffc5d380be in tbb::detail::d1::task_arena_function<Intel::OpenCL::TaskExecutor::immediate_executor_task, void>::operator()() const () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#34 0x00007fffb9a29994 in tbb::detail::r1::task_arena_impl::execute (ta=..., d=...) at src/tbb/arena.cpp:863
        context_guard = {curr_ctx = 0x0, guard_cpu_ctl_env = {mxcsr = 8064, x87cw = 895, static MXCSR_CONTROL_MASK = -64}, curr_cpu_ctl_env = {mxcsr = 8064, x87cw = 895, static MXCSR_CONTROL_MASK = -64}}
        scope = {<tbb::detail::d0::no_copy> = {<tbb::detail::d0::no_assign> = {<No data fields>}, <No data fields>}, m_orig_execute_data_ext = {<tbb::detail::d1::execution_data> = {context = 0x7fffb95d5780, original_slot = 0, affinity_slot = 65535}, task_disp = 0x7fffc8321e00, isolation = 0, wait_ctx = 0x0}, m_orig_arena = 0x0, m_orig_last_observer = 0x0, m_task_dispatcher = 0x7fffc8321e00, m_orig_slot_index = 0, m_orig_fifo_tasks_allowed = true, m_orig_critical_task_allowed = true, m_orig_is_thread_registered = false}
        a = 0x7fffc831ec00
        td = <optimized out>
        index1 = <optimized out>
        same_arena = <optimized out>
        waiter = {<tbb::detail::r1::wait_node<unsigned long>> = {<tbb::detail::r1::circular_doubly_linked_list_with_sentinel::base_node> = {next = <optimized out>, prev = <optimized out>}, _vptr$wait_node = <optimized out>, my_context = <optimized out>, my_is_in_list = {_M_base = {static _S_alignment = 1, _M_i = <optimized out>}}, my_initialized = <optimized out>, my_skipped_wakeup = <optimized out>, my_aborted = <optimized out>, my_epoch = <optimized out>}, sema = {aligned_array = {<optimized out>, <optimized out>, <optimized out>, <optimized out>}}}
        wo = {static overflow_mask = 18446744069414584320, m_version_and_traits = <optimized out>, m_ref_count = {<std::__atomic_base<unsigned long>> = {static _S_alignment = 8, _M_i = <optimized out>}, <No data fields>}}
        exec_context = {<tbb::detail::d0::no_copy> = {<tbb::detail::d0::no_assign> = {<No data fields>}, <No data fields>}, my_cpu_ctl_env = <optimized out>, my_cancellation_requested = {<std::__atomic_base<unsigned int>> = {static _S_alignment = 4, _M_i = <optimized out>}, <No data fields>}, my_version = <optimized out>, my_traits = {fp_settings = <optimized out>, concurrent_wait = <optimized out>, bound = <optimized out>, reserved1 = <optimized out>, reserved2 = <optimized out>, reserved3 = <optimized out>, reserved4 = <optimized out>, reserved5 = <optimized out>}, static may_have_children = 1 '\001', my_may_have_children = {<std::__atomic_base<unsigned char>> = {static _S_alignment = 1, _M_i = <optimized out>}, <No data fields>}, my_state = {static _S_min_alignment = 1, static _S_alignment = 1, _M_i = <optimized out>}, {my_parent = <optimized out>, my_actual_context = <optimized out>}, my_context_list = <optimized out>, my_node = {my_prev_node = <optimized out>, my_next_node = <optimized out>}, my_exception = {_M_b = {_M_p = <optimized out>}}, my_itt_caller = <optimized out>, my_name = <optimized out>, padding = {<optimized out> <repeats 56 times>}}
        index2 = <optimized out>
        exception = <optimized out>
        dt = {<tbb::detail::d1::task> = {<tbb::detail::d1::task_traits> = {m_version_and_traits = <optimized out>}, _vptr$task = <optimized out>, m_reserved = {<optimized out>, <optimized out>, <optimized out>, <optimized out>, <optimized out>, <optimized out>}}, m_delegate = <optimized out>, m_monitor = <optimized out>, m_wait_ctx = <optimized out>, m_completed = {_M_base = {static _S_alignment = 1, _M_i = <optimized out>}}}
        scope = {<tbb::detail::d0::no_copy> = {<tbb::detail::d0::no_assign> = {<No data fields>}, <No data fields>}, m_orig_execute_data_ext = {<tbb::detail::d1::execution_data> = {context = <optimized out>, original_slot = <optimized out>, affinity_slot = <optimized out>}, task_disp = <optimized out>, isolation = <optimized out>, wait_ctx = <optimized out>}, m_orig_arena = <optimized out>, m_orig_last_observer = <optimized out>, m_task_dispatcher = <optimized out>, m_orig_slot_index = <optimized out>, m_orig_fifo_tasks_allowed = <optimized out>, m_orig_critical_task_allowed = <optimized out>, m_orig_is_thread_registered = <optimized out>}
#35 tbb::detail::r1::execute (ta=..., d=...) at src/tbb/arena.cpp:544
No locals.
#36 0x00007fffc5d35d24 in Intel::OpenCL::TaskExecutor::immediate_command_list::LaunchExecutorTask(bool, Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::TaskExecutor::ITaskBase> const&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#37 0x00007fffc5ccd00a in Intel::OpenCL::Framework::FrameworkProxy::ExecuteImmediate(Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::TaskExecutor::ITaskBase> const&) const () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#38 0x00007fffc5c79c93 in Intel::OpenCL::Framework::BuildTask::Launch() () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#39 0x00007fffc5c79bc3 in Intel::OpenCL::Framework::BuildTask::DoneWithDependencies(Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::Framework::OclEvent> const&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#40 0x00007fffc5cc738d in non-virtual thunk to Intel::OpenCL::Framework::OclEvent::ObservedEventStateChanged(Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::Framework::OclEvent> const&, int) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#41 0x00007fffc5cc75ff in Intel::OpenCL::Framework::OclEvent::NotifyObservers(int) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#42 0x00007fffc5cc6f96 in Intel::OpenCL::Framework::OclEvent::SetEventState(Intel::OpenCL::Framework::OclEventState) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#43 0x00007fffc5c7a0ca in Intel::OpenCL::Framework::BuildTask::SetComplete(int) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#44 0x00007fffc5c7bf92 in Intel::OpenCL::Framework::LinkTask::Execute() () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#45 0x00007fffc5c7c391 in non-virtual thunk to Intel::OpenCL::Framework::LinkTask::Execute() () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#46 0x00007fffc5d1db11 in Intel::OpenCL::TaskExecutor::execute_command(Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::TaskExecutor::ITaskBase> const&, Intel::OpenCL::TaskExecutor::base_command_list&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#47 0x00007fffc5d380be in tbb::detail::d1::task_arena_function<Intel::OpenCL::TaskExecutor::immediate_executor_task, void>::operator()() const () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#48 0x00007fffb9a29994 in tbb::detail::r1::task_arena_impl::execute (ta=..., d=...) at src/tbb/arena.cpp:863
        context_guard = {curr_ctx = 0x0, guard_cpu_ctl_env = {mxcsr = 8064, x87cw = 895, static MXCSR_CONTROL_MASK = -64}, curr_cpu_ctl_env = {mxcsr = 8064, x87cw = 895, static MXCSR_CONTROL_MASK = -64}}
        scope = {<tbb::detail::d0::no_copy> = {<tbb::detail::d0::no_assign> = {<No data fields>}, <No data fields>}, m_orig_execute_data_ext = {<tbb::detail::d1::execution_data> = {context = 0x7fffb95f3a00, original_slot = 0, affinity_slot = 0}, task_disp = 0x7fffc830dc00, isolation = 0, wait_ctx = 0x0}, m_orig_arena = 0x7fffc830aa00, m_orig_last_observer = 0x0, m_task_dispatcher = 0x7fffc8321e00, m_orig_slot_index = 0, m_orig_fifo_tasks_allowed = true, m_orig_critical_task_allowed = true, m_orig_is_thread_registered = false}
        a = 0x7fffc831ec00
        td = <optimized out>
        index1 = <optimized out>
        same_arena = <optimized out>
        waiter = {<tbb::detail::r1::wait_node<unsigned long>> = {<tbb::detail::r1::circular_doubly_linked_list_with_sentinel::base_node> = {next = <optimized out>, prev = <optimized out>}, _vptr$wait_node = <optimized out>, my_context = <optimized out>, my_is_in_list = {_M_base = {static _S_alignment = 1, _M_i = <optimized out>}}, my_initialized = <optimized out>, my_skipped_wakeup = <optimized out>, my_aborted = <optimized out>, my_epoch = <optimized out>}, sema = {aligned_array = {<optimized out>, <optimized out>, <optimized out>, <optimized out>}}}
        wo = {static overflow_mask = 18446744069414584320, m_version_and_traits = <optimized out>, m_ref_count = {<std::__atomic_base<unsigned long>> = {static _S_alignment = 8, _M_i = <optimized out>}, <No data fields>}}
        exec_context = {<tbb::detail::d0::no_copy> = {<tbb::detail::d0::no_assign> = {<No data fields>}, <No data fields>}, my_cpu_ctl_env = <optimized out>, my_cancellation_requested = {<std::__atomic_base<unsigned int>> = {static _S_alignment = 4, _M_i = <optimized out>}, <No data fields>}, my_version = <optimized out>, my_traits = {fp_settings = <optimized out>, concurrent_wait = <optimized out>, bound = <optimized out>, reserved1 = <optimized out>, reserved2 = <optimized out>, reserved3 = <optimized out>, reserved4 = <optimized out>, reserved5 = <optimized out>}, static may_have_children = 1 '\001', my_may_have_children = {<std::__atomic_base<unsigned char>> = {static _S_alignment = 1, _M_i = <optimized out>}, <No data fields>}, my_state = {static _S_min_alignment = 1, static _S_alignment = 1, _M_i = <optimized out>}, {my_parent = <optimized out>, my_actual_context = <optimized out>}, my_context_list = <optimized out>, my_node = {my_prev_node = <optimized out>, my_next_node = <optimized out>}, my_exception = {_M_b = {_M_p = <optimized out>}}, my_itt_caller = <optimized out>, my_name = <optimized out>, padding = {<optimized out> <repeats 56 times>}}
        index2 = <optimized out>
        exception = <optimized out>
        dt = {<tbb::detail::d1::task> = {<tbb::detail::d1::task_traits> = {m_version_and_traits = <optimized out>}, _vptr$task = <optimized out>, m_reserved = {<optimized out>, <optimized out>, <optimized out>, <optimized out>, <optimized out>, <optimized out>}}, m_delegate = <optimized out>, m_monitor = <optimized out>, m_wait_ctx = <optimized out>, m_completed = {_M_base = {static _S_alignment = 1, _M_i = <optimized out>}}}
        scope = {<tbb::detail::d0::no_copy> = {<tbb::detail::d0::no_assign> = {<No data fields>}, <No data fields>}, m_orig_execute_data_ext = {<tbb::detail::d1::execution_data> = {context = <optimized out>, original_slot = <optimized out>, affinity_slot = <optimized out>}, task_disp = <optimized out>, isolation = <optimized out>, wait_ctx = <optimized out>}, m_orig_arena = <optimized out>, m_orig_last_observer = <optimized out>, m_task_dispatcher = <optimized out>, m_orig_slot_index = <optimized out>, m_orig_fifo_tasks_allowed = <optimized out>, m_orig_critical_task_allowed = <optimized out>, m_orig_is_thread_registered = <optimized out>}
#49 tbb::detail::r1::execute (ta=..., d=...) at src/tbb/arena.cpp:544
No locals.
#50 0x00007fffc5d35d24 in Intel::OpenCL::TaskExecutor::immediate_command_list::LaunchExecutorTask(bool, Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::TaskExecutor::ITaskBase> const&) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#51 0x00007fffc5ccd00a in Intel::OpenCL::Framework::FrameworkProxy::ExecuteImmediate(Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::TaskExecutor::ITaskBase> const&) const () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#52 0x00007fffc5c79c93 in Intel::OpenCL::Framework::BuildTask::Launch() () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#53 0x00007fffc5c80719 in Intel::OpenCL::Framework::ProgramService::LinkProgram(Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::Framework::Program> const&, unsigned int, _cl_device_id* const*, unsigned int, Intel::OpenCL::Utils::SharedPtr<Intel::OpenCL::Framework::Program>*, char const*, void (*)(_cl_program*, void*), void*) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#54 0x00007fffc5c5ba7b in Intel::OpenCL::Framework::Context::LinkProgram(_cl_program*, unsigned int, _cl_device_id* const*, unsigned int, _cl_program* const*, char const*, void (*)(_cl_program*, void*), void*) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#55 0x00007fffc5c3cc2f in Intel::OpenCL::Framework::ContextModule::LinkProgram(_cl_context*, unsigned int, _cl_device_id* const*, char const*, unsigned int, _cl_program* const*, void (*)(_cl_program*, void*), void*, int*) () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#56 0x00007fffc5c11a0c in clLinkProgram () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libintelocl.so
No symbol table info available.
#57 0x00007fffed9c1920 in clLinkProgram () from /nas/store/sivaramp/spack/opt/spack/linux-x86_64_v3/intel-oneapi-compilers-2025.1.0-ntleihfxw77huvjwkcpteddp3cqvae42/compiler/2025.1/lib/libOpenCL.so
No symbol table info available.
#58 0x00000000004b730b in hc_clLinkProgram (hashcat_ctx=0x6102b0, context=0x852d38, num_devices=1, device_list=0x7fffc9c154e8, options=0x0, num_input_programs=1, input_programs=0x7fffffff3ff8, pfn_notify=0x0, user_data=0x0, program=0x7fffffff3ff0) at src/ext_OpenCL.c:634
        backend_ctx = 0x610b50
        ocl = 0x16399b0
        CL_err = 32767
#59 0x0000000000489709 in load_kernel (hashcat_ctx=0x6102b0, device_param=0x7fffc9a8e010, kernel_name=0x5db0b2 "main_kernel", source_file=0x7fffffff42c0 "/nas/store/sivaramp/hashcat/OpenCL/m01500_a3-pure.cl", cached_file=0x7fffffff43c0 "/nas/store/sivaramp/hashcat/kernels/m01500_a3-pure.9134174d.kernel", build_options_buf=0x1630460 "-D KERNEL_STATIC -D INCLUDE_PATH=/nas/store/sivaramp/hashcat/OpenCL -D XM2S(x)=#x -D M2S(x)=XM2S(x) -D LOCAL_MEM_TYPE=2 -D VENDOR_ID=8 -D CUDA_ARCH=0 -D HAS_ADD=0 -D HAS_ADDC=0 -D HAS_SUB=0 -D HAS_SUB"..., cache_disable=true, opencl_program=0x7fffc9c15500, cuda_module=0x7fffc9c15050, hip_module=0x7fffc9c15298, metal_library=0x0) at src/backend.c:8967
        t2 = {0x8b4ce68}
        fin = 0x0
        build_log_size = 38
        CL_rc = 0
        p1 = 0x8b4ce68
        hashconfig = 0x610590
        user_options = 0x6160d0
        folder_config = 0x610530
        cached = false
        kernel_lengths_buf = 127113
        kernel_lengths = 0x7fffffff40c0
        kernel_sources_buf = 0x5000fa0 "/**\n * Author......: See docs/credits.txt\n * License.....: MIT\n * NOTE........: sboxes for maxwell were taken from DeepLearningJohnDoe, license below\n *", ' ' <repeats 13 times>, ": sboxes for others were takes fron"...
        kernel_sources = 0x7fffffff40b8
#60 0x000000000048dfed in backend_session_begin (hashcat_ctx=0x6102b0) at src/backend.c:10631
        build_options_module_buf = 0x1630460 "-D KERNEL_STATIC -D INCLUDE_PATH=/nas/store/sivaramp/hashcat/OpenCL -D XM2S(x)=#x -D M2S(x)=XM2S(x) -D LOCAL_MEM_TYPE=2 -D VENDOR_ID=8 -D CUDA_ARCH=0 -D HAS_ADD=0 -D HAS_ADDC=0 -D HAS_SUB=0 -D HAS_SUB"...
        build_options_module_len = 633
        device_name_chksum = "9134174d\000\061-0-0-0-1-8-AMD EPYC 7443P 24-Core Processor-OpenCL 3.0 (Build 0)-2025.19.3.0.17_230222-8-1500-100-1--D KERNEL_STATIC -D INCLUDE_PATH=/nas/store/sivaramp/hashcat/OpenCL -D XM2S(x)=#x -D M2S(x"...
        dnclen = 743
        cached_file = "/nas/store/sivaramp/hashcat/kernels/m01500_a3-pure.9134174d.kernel", '\000' <repeats 189 times>
        rc_load_kernel = false
        extra_value = 100
        source_file = "/nas/store/sivaramp/hashcat/OpenCL/m01500_a3-pure.cl", '\000' <repeats 203 times>
        device_param = 0x7fffc9a8e010
        size_combs = 266240
        size_st_esalts = 0
        device_name_chksum_amp_mp = "0db9e30f\000\061-0-0-0-1-8-AMD EPYC 7443P 24-Core Processor-OpenCL 3.0 (Build 0)-2025.19.3.0.17_230222-1", '\000' <repeats 3997 times>
        dnclen_amp_mp = 98
        size_pws_idx = 0
        device_processors = 48
        aligned_rules_cnt = 1024
        size_esalts = 0
        size_digests = 16
        build_options_sz = 4096
        size_pws_base = 0
        size_tmps = 0
        pws_idx = 0x0
        combs_buf = 0x0
        vector_width = 8
        size_tm = 4096
        size_kernel_params = 64
        kern_type = 1500
        size_pws_pre = 0
        pws_comp = 0x0
        size_root_css = 263168
        size_shown = 4
        size_pws_comp = 0
        size_brain_link_out = 0
        pws_pre_buf = 0x0
        size_extra_buffer = 4
        brain_link_in_buf = 0x0
        size_rules = 131072
        size_rules_c = 32768
        size_bfs = 4096
        md5_ctx = {h = {2436110157, 1596263405, 2940726769, 3975480443}, w0 = {1162104653, 538981181, 1142965293, 1380143941}, w1 = {1599361113, 1414283603, 943207229, 541338912}, w2 = {1919841631, 2154589295, 0, 0}, w3 = {0, 0, 5944, 0}, len = 743}
        tuningdb_entry = 0x0
        size_pws = 131856
        device_id = 0
        size_salts = 568
        size_total_fixed = 0
        hardware_power_max = 0
        accel_limit = 6381776
        size_brain_link_in = 0
        size_results = 4
        size_st_salts = 568
        build_options_buf = 0x849e70 "-D KERNEL_STATIC -D INCLUDE_PATH=/nas/store/sivaramp/hashcat/OpenCL -D XM2S(x)=#x -D M2S(x)=XM2S(x) -D LOCAL_MEM_TYPE=2 -D VENDOR_ID=8 -D CUDA_ARCH=0 -D HAS_ADD=0 -D HAS_ADDC=0 -D HAS_SUB=0 -D HAS_SUB"...
        pws_base_buf = 0x0
        size_markov_css = 67371008
        kernel_accel_min = 0
        SIZE_4GB = 0
        scratch_buf = 0x0
        size_plains = 32
        size_st_digests = 16
        build_options_len = 601
        cache_disable = true
        size_hooks = 0
        brain_link_out_buf = 0x0
        kernel_accel_max = 0
        size_pws_amp = 1
        hooks_buf = 0x0
        backend_devices_idx = 0
        bitmap_ctx = 0x6103b0
        folder_config = 0x610530
        hashconfig = 0x610590
        hashes = 0x610670
        module_ctx = 0x6108d0
        backend_ctx = 0x610b50
        straight_ctx = 0x616020
        user_options_extra = 0x616090
        user_options = 0x6160d0
        size_total_host_all = 0
        hardware_power_all = 0
        backend_memory_hit_warnings = 0
        backend_runtime_skip_warnings = 0
        backend_kernel_build_warnings = 0
        backend_kernel_create_warnings = 0
        backend_kernel_accel_warnings = 0
        backend_extra_size_warning = 0
        rc = 0
#61 0x000000000040900b in outer_loop (hashcat_ctx=0x6102b0) at src/hashcat.c:845
        hashconfig = 0x610590
        hashes = 0x610670
        mask_ctx = 0x610840
        module_ctx = 0x6108d0
        backend_ctx = 0x610b50
        outcheck_ctx = 0x615d80
        restore_ctx = 0x615ea0
        status_ctx = 0x615ee0
        straight_ctx = 0x616020
        user_options = 0x6160d0
        user_options_extra = 0x616090
        inner_threads_cnt = 0
        inner_threads = 0x0
#62 0x000000000040af77 in hashcat_session_execute (hashcat_ctx=0x6102b0) at src/hashcat.c:1764
        quiet_sav = false
        folder_config = 0x610530
        logfile_ctx = 0x6107b0
        status_ctx = 0x615ee0
        user_options = 0x6160d0
        backend_ctx = 0x610b50
        proc_start = 1745341336
        rc_final = -1
        proc_stop = 0
#63 0x0000000000406bc1 in main (argc=4, argv=0x7fffffff6b58) at src/main.c:1353
        proc_start = 1745341335
        hashcat_ctx = 0x6102b0
        install_folder = 0x5c9ac0 "/usr/local/bin"
        shared_folder = 0x5c9acf "/usr/local/share/hashcat"
        user_options = 0x6160d0
        rc_final = -1
        proc_stop = 4607
Undefined command: "exit".  Try "help".
quit

[JablonskiMateusz]

it looks like you are using CPU device (libintelocl.so) , not GPU (libigdrcl.so)

[JablonskiMateusz]

what kind of device is that?

Vendor.........: Intel(R) Corporation
Name...........: AMD EPYC 9745 128-Core Processor

[JablonskiMateusz]

This issue is out of scope of this GitHub project, which is GPU-only. It may also be out of scope of the OpenCL CPU project, if you are indeed using AMD CPU with Intel software, which would be unsupported configuration