Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Inference & Training] My Onnxruntime isnt detecting cuda even after all paths are perfectly given with compatible softwares #22016

Open
1 task
tamannashah18 opened this issue Sep 6, 2024 · 1 comment
Labels
ep:CUDA issues related to the CUDA execution provider training issues related to ONNX Runtime training; typically submitted using template

Comments

@tamannashah18
Copy link

tamannashah18 commented Sep 6, 2024

Describe the issue

024-09-06 15:00:41.0156984 [E:onnxruntime:Default, provider_bridge_ort.cc:1992 onnxruntime::TryGetProviderInfo_CUDA] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\EYIC\Git repo handwriting\Git repo handwriting\Handwriting _Analysis\venv\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll"

2024-09-06 15:00:41.0416597 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:965 onnxruntime::python::CreateExecutionProviderInstance] Failed to create CUDAExecutionProvider. Require cuDNN 9.* and CUDA 12.*, and the latest MSVC runtime. Please install all dependencies as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported.
2024-09-06 15:00:42.0969770 [E:onnxruntime:Default, provider_bridge_ort.cc:1992 onnxruntime::TryGetProviderInfo_CUDA] D:\a_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1637 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\EYIC\Git repo handwriting\Git repo handwriting\Handwriting _Analysis\venv\Lib\site-packages\onnxruntime\capi\onnxruntime_providers_cuda.dll"

2024-09-06 15:00:42.1120911 [W:onnxruntime:Default, onnxruntime_pybind_state.cc:965 onnxruntime::python::CreateExecutionProviderInstance] Failed to create CUDAExecutionProvider. Require cuDNN 9.* and CUDA 12.*, and the latest MSVC runtime. Please install all dependencies as mentioned in the GPU requirements page (https://onnxruntime.ai/docs/execution-providers/CUDA-ExecutionProvider.html#requirements), make sure they're in the PATH, and that your GPU is supported.
Monitoring directory: data/images

To reproduce

i want it to run on CUDA

Urgency

It is an urgent matter

ONNX Runtime Installation

Built from Source

ONNX Runtime Version or Commit ID

1.19.2

PyTorch Version

2.4

Execution Provider

Default CPU, CUDA

Execution Provider Library Version

cuda 12.4

Tasks

@tamannashah18 tamannashah18 added the training issues related to ONNX Runtime training; typically submitted using template label Sep 6, 2024
@github-actions github-actions bot added the ep:CUDA issues related to the CUDA execution provider label Sep 6, 2024
@tamannashah18 tamannashah18 changed the title [Training] My Onnxruntime isnt detecting cuda even after all paths are perfectly given with compatible softwares [Infeerence & Training] My Onnxruntime isnt detecting cuda even after all paths are perfectly given with compatible softwares Sep 6, 2024
@tamannashah18 tamannashah18 changed the title [Infeerence & Training] My Onnxruntime isnt detecting cuda even after all paths are perfectly given with compatible softwares [Inference & Training] My Onnxruntime isnt detecting cuda even after all paths are perfectly given with compatible softwares Sep 6, 2024
@tianleiwu
Copy link
Contributor

See #22000 (comment)

r-devulap pushed a commit to r-devulap/onnxruntime that referenced this issue Sep 9, 2024
…icrosoft#21333)

### Description
<!-- Describe your changes. -->



### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:CUDA issues related to the CUDA execution provider training issues related to ONNX Runtime training; typically submitted using template
Projects
None yet
Development

No branches or pull requests

2 participants