Open
Description
System Info
Platform Debain 12
Python Version 3.12
Hardware Radeon 5600 XT
Reproduction
python -m bitsandbytes
I get the following error when I try to run python -m bitsandbytes.
Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
and open an issue at: https://github.com/bitsandbytes-foundation/bitsandbytes/issues
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
++++++++++++++++++ BUG REPORT INFORMATION ++++++++++++++++++
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
++++++++++++++++++++++++++ OTHER +++++++++++++++++++++++++++
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/home/apatton/.pyenv/versions/fineTune/lib/python3.12/site-packages/bitsandbytes/__main__.py", line 4, in <module>
main()
File "/home/apatton/.pyenv/versions/fineTune/lib/python3.12/site-packages/bitsandbytes/diagnostics/main.py", line 51, in main
cuda_specs = get_cuda_specs()
^^^^^^^^^^^^^^^^
File "/home/apatton/.pyenv/versions/fineTune/lib/python3.12/site-packages/bitsandbytes/cuda_specs.py", line 39, in get_cuda_specs
cuda_version_string=(get_cuda_version_string()),
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/apatton/.pyenv/versions/fineTune/lib/python3.12/site-packages/bitsandbytes/cuda_specs.py", line 29, in get_cuda_version_string
major, minor = get_cuda_version_tuple()
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/apatton/.pyenv/versions/fineTune/lib/python3.12/site-packages/bitsandbytes/cuda_specs.py", line 24, in get_cuda_version_tuple
major, minor = map(int, torch.version.cuda.split("."))
^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'split'
I have tried to point to any '.so' files for rocm, hip, or cuda with no luck.
Expected behavior
I would expect the module to load.