CUDA support from Windows

[robante15]

How can I install pywhispercpp with CUDA support from Windows?
Adding the environment variable WHISPER_CUDA=1 does not cause any changes in the compilation

[abdeladim-s]

Can you try with GGML_CUDA=1 instead ?

[robante15]

In this case it does compile, and it does generate the DLL
But when I run it I get the following error:

PS E:\Github\TG_WhisperCpp> & e:/Github/TG_WhisperCpp/.venv/Scripts/python.exe e:/Github/TG_WhisperCpp/main.py
Traceback (most recent call last):
  File "e:\Github\TG_WhisperCpp\main.py", line 4, in <module>
    import pywhisp
  File "e:\Github\TG_WhisperCpp\pywhisp.py", line 1, in <module>
    from pywhispercpp.model import Model
  File "E:\Github\TG_WhisperCpp\.venv\lib\site-packages\pywhispercpp\__init__.py", line 14, in <module>
    ctypes.CDLL(os.path.join(os.path.dirname(__file__), 'lib', file))
  File "C:\Users\Roberto Acevedo\AppData\Local\Programs\Python\Python310\lib\ctypes\__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
FileNotFoundError: Could not find module 'E:\Github\TG_WhisperCpp\.venv\lib\site-packages\pywhispercpp\lib\ggml.dll' (or one of its dependencies). Try using the full path with constructor syntax.

[abdeladim-s]

Could you please check what's inside the lib folder E:\Github\TG_WhisperCpp\.venv\lib\site-packages\pywhispercpp\lib\ ? and whether the ggml.dll file is there ?

[robante15]

Inside the folder E:\Github\TG_WhisperCpp\.venv\Lib\site-packages\pywhispercpp\lib there are three files

_pywhispercpp.cp310-win_amd64.pyd
ggml.dll
whisper.dll

[abdeladim-s]

It seems good to me! the ggml.dll file is there! Idk why it's complaining about not finding it!

Are you able to compile and run whisper.cpp with cuda support ?