Skip to content

Conversation

@MiggiV2
Copy link
Contributor

@MiggiV2 MiggiV2 commented Jun 27, 2025

Motivation

This PR updates PyTorch from version 2.6.0+cu124 to 2.7.1+cu128 to support newer GPU architectures, specifically the RTX 50 series cards (RTX 5070, etc.). The current PyTorch version lacks support for these latest GPUs, preventing users with newer hardware from using the application.

Changes

  • pyproject.toml: Updated PyTorch dependency from torch==2.6.0+cu124 to torch==2.7.1+cu128
  • Dockerfile: Updated CUDA base image from version 12.8.0 to 12.8.1 to match the PyTorch CUDA requirements

Testing

  • ✅ Tested containerized deployment - works correctly
  • ✅ Tested non-Docker deployment - works correctly
  • ✅ Verified GPU functionality - RTX 5070 now supported
  • ✅ Verified CPU fallback - continues to work as expected

Related Issues

Fixes #344 - Request for different CUDA version containers for RTX 5000 series support
Fixes #320 - Compatibility issue with RTX 50 Series cards due to outdated PyTorch version

Benefits

  • Enables support for RTX 50 series GPUs out of the box
  • Reduces the need for users to manually rebuild containers
  • Maintains backward compatibility with existing GPU configurations
  • Improves environmental impact by providing pre-built containers instead of requiring individual rebuilds

This update ensures that users with the latest GPU hardware can use the application without manual modifications while maintaining compatibility with existing setups.

@atkinsjb
Copy link

@fireblade2534 +1 for this PR. I would very much like this to work on my 5060

@realugbun
Copy link

I built the GPU container from MiggiV2's PR. Wow. Blazing fast on Blackwell! Please merge this PR so we can get all the updates. The PR is already a few commits behind main.

@fireblade2534
Copy link
Collaborator

Nice work thx

@fireblade2534 fireblade2534 merged commit 29066f7 into remsky:master Jul 4, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Please release different CUDA version containers Doesn't work on the latest RTX 50 Series cards due to Python Torch version

4 participants