CPAI 2.9.5 on Intel iGPU, YOLOv5.NET does not work with GPU

[sklaffa]

Hi All, very first post from my side so I apologize for the (probably) noob question.
I'm currently using CPAI on a Ubuntu server w/ a GTX 1650 GPU. The YOLOv5 6.2 module works OK and uses the Nvidia GPU through CUDA. Now, I want to install a second instance of CPAI on an Intel Core i5 11400, 16 GB RAM, no discrete GPU, and I'm trying to see if I can use the Intel UHD 730 iGPU with CPAI.
I tried to make the YOLOv5 .NET module work through DirectML, with no luck. If I force disable the GPU, the module works; if I enable the GPU, it hangs without any significant error/warning in the logs (in the CPAI dashboard the module appears with black background and the "Lost contact" message on it). I tried disabling half-precision but nothing changes.
The PC uses a vanilla Windows 11 24H2 installation, all Windows updates installed, latest Intel drivers. Any clues/suggestions?

[alliasx]

I am on the same version of CPAI. I just tried .net and had the same issues as you described. I've been using yolo 5.6.2 cuda for a while with no problems. It may be the latest .net update that is conflicting. I'll be testing this more later this week.

[sklaffa]

Thanks for the response.
I experimented quite a lot and in the end the module does indeed work, but for unknown reasons it takes forever for it to become responsive (after starting the CPAI service, I must wait some minutes before the module actually runs and replies to queries). I also tried with a clean installation of Windows 10 (who knows, maybe it could be some incompatibility at OS level) to no avail (same symptoms).

As a workaround, I gave up using the Yolo.NET module, I recycled an Nvidia GTX 1650 GPU from another PC and I currently use that GPU with the Yolo 5.6 and CUDA. It costs me some extra electric power consumption but it works. If you find out some useful insights, I would be glad to know.

thanks, best regards
Filippo

[Christos977]

Running into the same isssue, i followed the below which is a temp fix that is working. The below script will detect a word in my example its "response" as i was testing, best to set a specific word that pops up on your error. Then it will click start button again to restart the service and then click clear logs.

Install Tampermonkey extension.

Create a new script.

Paste the following code and modify the TEXT_TO_DETECT and BUTTON_SELECTOR

(How to Find the Button Selector)
Right-click the button in your browser > Inspect.

Right-click the HTML element > Copy > Copy selector (or look for a class or ID).)

-// ==UserScript==
// @name Detect "Response" and Click Start + Clear Logs
// @namespace http://tampermonkey.net/
// @Version 1.0
// @description Clicks Start and Clear Logs when "Response" is detected on the page.
// @author You
// @match :///*
// @grant none
// ==/UserScript==

(function() {
'use strict';

const TEXT_TO_DETECT = "Response";

// Adjusted to click <a> or parent of <svg> since <path> cannot be clicked directly
const START_BUTTON_SELECTOR = "#module-info-ObjectDetectionYOLOv5Net > div.ms-2.text-nowrap > a.me-1";

const CLEAR_LOGS_BUTTON_SELECTOR = "#status-panel > div:nth-child(1) > div > div.d-flex.small > div.ms-auto > a";

let hasActed = false;

function clickButton(selector, label) {
    const btn = document.querySelector(selector);
    if (btn) {
        console.log(`✅ Clicking: ${label}`);
        btn.click();
    } else {
        console.log(`❌ Button not found: ${label}`);
    }
}

function detectAndAct() {
    const textFound = document.body.innerText.includes(TEXT_TO_DETECT);

    if (textFound && !hasActed) {
        hasActed = true;
        clickButton(START_BUTTON_SELECTOR, "Start Button");

        // Wait before clicking Clear Logs
        setTimeout(() => {
            clickButton(CLEAR_LOGS_BUTTON_SELECTOR, "Clear Logs Button");
        }, 1500);
    }

    // Optional: reset if text disappears
    if (!textFound && hasActed) {
        hasActed = false;
        console.log("🔄 Text disappeared, reset");
    }
}

setInterval(detectAndAct, 2000);

})();