Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Azure] Update default image to support newer cuda versions #2751

Closed
romilbhardwaj opened this issue Nov 2, 2023 · 2 comments
Closed

[Azure] Update default image to support newer cuda versions #2751

romilbhardwaj opened this issue Nov 2, 2023 · 2 comments

Comments

@romilbhardwaj
Copy link
Collaborator

The current image used for Azure has an old version of nvidia drivers:

(base) azureuser@ray-dbg-2ea4-head-5f89-adf20:~$ nvidia-smi
Thu Nov  2 21:54:46 2023
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 495.29.05    Driver Version: 495.29.05    CUDA Version: 11.5     |
|-------------------------------+----------------------+----------------------+

This version of nvidia drivers does not support CUDA 11.8. This is problematic for many reasons, including the latest pytorch supporting only CUDA 11.8+.

In contrast, AWS and GCP run 5xx.yy nvidia drivers, which support newer cuda versions.

@Michaelvll
Copy link
Collaborator

This is being fixed by #2468

@Michaelvll
Copy link
Collaborator

This should be fixed by #2468. Closing this issue now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants