CUDA Setup failed despite GPU being available.

[dvShilenko]

System Info

i work on a station with different GPUs. I want to start FSDP fine-tuning, I install trl, accelerate, bitsandbytes etc. but then there are many problems reveal. Also I tried to reinstall libraries, I faced with problems with GPU libraries and these errors.

And now there are problems even in importing bitsandbytes

Reproduction

import bitsandbytes

Expected behavior

i want to resolve conflicts in dependencies

[SRagy]

I'm having the same issue. After trying various fixes proposed here for other people's problems I am still left with this

EDIT:
Fixed it by doing manual cloning bits and bytes repository and then doing a manual set-up with a few extra steps... Maybe this will work for someone else. Especially, the last two lines.

pip uninstall bitsandbytes
git clone bitsandbytes
cd bitsandbytes
python setup.py install
cmake -DCOMPUTE_BACKEND=cuda -S .
make CUDA_VERSION=124

in terminal. Error still included below for posterity.

WARNING: BNB_CUDA_VERSION=124 environment variable detected; loading libbitsandbytes_cuda124.so.
This can be used to load a bitsandbytes version that is different from the PyTorch CUDA version.
If this was unintended set the BNB_CUDA_VERSION variable to an empty string: export BNB_CUDA_VERSION=
If you use the manual override make sure the right libcudart.so is in your LD_LIBRARY_PATH
For example by adding the following to your .bashrc: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<path_to_cuda_dir/lib64

Could not find the bitsandbytes CUDA binary at PosixPath('/notebooks/bitsandbytes/bitsandbytes/libbitsandbytes_cuda124.so')
Could not load bitsandbytes native library: /notebooks/bitsandbytes/bitsandbytes/libbitsandbytes_cpu.so: cannot open shared object file: No such file or directory
Traceback (most recent call last):
  File "/notebooks/bitsandbytes/bitsandbytes/cextension.py", line 85, in <module>
    lib = get_native_library()
          ^^^^^^^^^^^^^^^^^^^^
  File "/notebooks/bitsandbytes/bitsandbytes/cextension.py", line 72, in get_native_library
    dll = ct.cdll.LoadLibrary(str(binary_path))
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/ctypes/__init__.py", line 454, in LoadLibrary
    return self._dlltype(name)
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/ctypes/__init__.py", line 376, in __init__
    self._handle = _dlopen(self._name, mode)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: /notebooks/bitsandbytes/bitsandbytes/libbitsandbytes_cpu.so: cannot open shared object file: No such file or directory

CUDA Setup failed despite CUDA being available. Please run the following command to get more information:

python -m bitsandbytes

Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
and open an issue at: https://github.com/bitsandbytes-foundation/bitsandbytes/issues

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
++++++++++++++++++ BUG REPORT INFORMATION ++++++++++++++++++
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
++++++++++++++++++++++++++ OTHER +++++++++++++++++++++++++++
CUDA specs: CUDASpecs(highest_compute_capability=(8, 6), cuda_version_string='124', cuda_version_tuple=(12, 4))
PyTorch settings found: CUDA_VERSION=124, Highest Compute Capability: (8, 6).
WARNING: BNB_CUDA_VERSION=124 environment variable detected; loading libbitsandbytes_cuda124.so.
This can be used to load a bitsandbytes version that is different from the PyTorch CUDA version.
If this was unintended set the BNB_CUDA_VERSION variable to an empty string: export BNB_CUDA_VERSION=
If you use the manual override make sure the right libcudart.so is in your LD_LIBRARY_PATH
For example by adding the following to your .bashrc: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<path_to_cuda_dir/lib64

Library not found: /notebooks/bitsandbytes/bitsandbytes/libbitsandbytes_cuda124.so. Maybe you need to compile it from source?
If you compiled from source, try again with `make CUDA_VERSION=DETECTED_CUDA_VERSION`,
for example, `make CUDA_VERSION=113`.

The CUDA version for the compile might depend on your conda install, if using conda.
Inspect CUDA version via `conda list | grep cuda`.
To manually override the PyTorch CUDA version please see: https://github.com/TimDettmers/bitsandbytes/blob/main/docs/source/nonpytorchcuda.mdx
The directory listed in your path is found to be non-existent: //ndkxbg8rdl
The directory listed in your path is found to be non-existent: 8888
The directory listed in your path is found to be non-existent: //10.43.0.1
The directory listed in your path is found to be non-existent: //10.43.0.1
CUDA SETUP: WARNING! CUDA runtime files not found in any environmental path.
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
++++++++++++++++++++++ DEBUG INFO END ++++++++++++++++++++++
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Checking that the library is importable and CUDA is callable...
Couldn't load the bitsandbytes library, likely due to missing binaries.
Please ensure bitsandbytes is properly installed.

For source installations, compile the binaries with `cmake -DCOMPUTE_BACKEND=cuda -S .`.
See the documentation for more details if needed.

Trying a simple check anyway, but this will likely fail...
Traceback (most recent call last):
  File "/notebooks/bitsandbytes/bitsandbytes/diagnostics/main.py", line 66, in main
    sanity_check()
  File "/notebooks/bitsandbytes/bitsandbytes/diagnostics/main.py", line 40, in sanity_check
    adam.step()
  File "/usr/local/lib/python3.11/dist-packages/torch/optim/optimizer.py", line 493, in wrapper
    out = func(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/notebooks/bitsandbytes/bitsandbytes/optim/optimizer.py", line 291, in step
    self.update_step(group, p, gindex, pindex)
  File "/usr/local/lib/python3.11/dist-packages/torch/utils/_contextlib.py", line 116, in decorate_context
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/notebooks/bitsandbytes/bitsandbytes/optim/optimizer.py", line 521, in update_step
    F.optimizer_update_32bit(
  File "/notebooks/bitsandbytes/bitsandbytes/functional.py", line 1572, in optimizer_update_32bit
    optim_func = str2optimizer32bit[optimizer_name][0]
                 ^^^^^^^^^^^^^^^^^^
NameError: name 'str2optimizer32bit' is not defined
Above we output some debug information.
Please provide this info when creating an issue via https://github.com/TimDettmers/bitsandbytes/issues/new/choose
WARNING: Please be sure to sanitize sensitive info from the output before posting it.

[vishalk31702]

Use cuda 11.8 as it is compatible to bitsandbytes

[krz]

I also have this problem and I'm out of ideas how to fix it. I used the script https://raw.githubusercontent.com/TimDettmers/bitsandbytes/main/install_cuda.sh to install CUDA 12.4 to ~/local.
My local CUDA install is 12.3 but it also does not work.
I added the paths to my .bashrc but it still does not find CUDA.
I want to fine-tune a gemma3 model with unsloth.

================================================================================
WARNING: Manual override via BNB_CUDA_VERSION env variable detected!
BNB_CUDA_VERSION=XXX can be used to load a bitsandbytes version that is different from the PyTorch CUDA version.
If this was unintended set the BNB_CUDA_VERSION variable to an empty string: export BNB_CUDA_VERSION=
If you use the manual override make sure the right libcudart.so is in your LD_LIBRARY_PATH
For example by adding the following to your .bashrc: export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:<path_to_cuda_dir/lib64
Loading CUDA version: BNB_CUDA_VERSION=124
================================================================================


  warn((f'\n\n{"="*80}\n'
False

===================================BUG REPORT===================================
/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: Welcome to bitsandbytes. For bug reports, please run

python -m bitsandbytes



  warn(msg)
================================================================================
/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: /home/aaaa/miniforge3/envs/unsloth did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
  warn(msg)
/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: :/home/aaaa/local/cuda-12.4/lib64:/home/aaaa/local/cuda-12.4/lib64:/home/aaaa/local/cuda-12.4:/home/aaaa/local/cuda-12.4:/home/aaaa/local/cuda-12.4/lib64 did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths...
  warn(msg)
The following directories listed in your path were found to be non-existent: {PosixPath('1')}
The following directories listed in your path were found to be non-existent: {PosixPath('1;/usr/share/modulefiles/Linux'), PosixPath('1;/usr/share/lmod/lmod/modulefiles/Core'), PosixPath('1;/usr/share/modulefiles'), PosixPath('17;/etc/modulefiles'), PosixPath('1;/usr/share/modulefiles/Core'), PosixPath('1')}
The following directories listed in your path were found to be non-existent: {PosixPath('1')}
The following directories listed in your path were found to be non-existent: {PosixPath('169.254.169.254,localhost,127.0.0.0/8,.aaaa.net,.amazonaws.com')}
The following directories listed in your path were found to be non-existent: {PosixPath('/home/aaaa/bin'), PosixPath('/home/aaaa/local/cuda-12.4/lib')}
The following directories listed in your path were found to be non-existent: {PosixPath('3128'), PosixPath('http'), PosixPath('//proxy-sase-gbln.aws.aaaa.net')}
The following directories listed in your path were found to be non-existent: {PosixPath('3128'), PosixPath('http'), PosixPath('//proxy-sase-gbln.aws.aaaa.net')}
The following directories listed in your path were found to be non-existent: {PosixPath('1')}
The following directories listed in your path were found to be non-existent: {PosixPath('/usr/share/modulefiles/Linux'), PosixPath('/usr/share/modulefiles/Core')}
The following directories listed in your path were found to be non-existent: {PosixPath('StdEnv'), PosixPath('Anaconda3/2021.05'), PosixPath('GCCcore/10.3.0'), PosixPath('dwarf/0.6.21')}
The following directories listed in your path were found to be non-existent: {PosixPath('3128'), PosixPath('http'), PosixPath('//proxy-sase-gbln.aws.aaaa.net')}
The following directories listed in your path were found to be non-existent: {PosixPath('3128'), PosixPath('http'), PosixPath('//proxy-sase-gbln.aws.aaaa.net')}
The following directories listed in your path were found to be non-existent: {PosixPath('1;/usr/bin'), PosixPath('1;/apps/easybuild/software/Anaconda3/2021.05/bin'), PosixPath('1;/apps/slrm/milliways/v20.11.8/bin'), PosixPath('1;/usr/local/bin'), PosixPath('1;/apps/easybuild/software/Anaconda3/2021.05/sbin'), PosixPath('1'), PosixPath('1;/apps/easybuild/software/dwarf/0.6.21/bin'), PosixPath('1;/apps/easybuild/software/Anaconda3/2021.05')}
The following directories listed in your path were found to be non-existent: {PosixPath('169.254.169.254,localhost,127.0.0.0/8,.aaaa.net,.amazonaws.com')}
The following directories listed in your path were found to be non-existent: {PosixPath('3128'), PosixPath('http'), PosixPath('//proxy-sase-gbln.aws.aaaa.net')}
The following directories listed in your path were found to be non-existent: {PosixPath('1'), PosixPath('1;/apps/easybuild/software/GCCcore/10.3.0/lib')}
The following directories listed in your path were found to be non-existent: {PosixPath('1')}
The following directories listed in your path were found to be non-existent: {PosixPath('1;/apps/easybuild/software/Anaconda3/2021.05/man'), PosixPath('1;/usr/share/lmod/lmod/share/man'), PosixPath('1'), PosixPath('1;/apps/easybuild/software/Anaconda3/2021.05/share/man')}
The following directories listed in your path were found to be non-existent: {PosixPath('() {  eval "$($LMOD_DIR/ml_cmd "$@")"\n}')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
DEBUG: Possible options found for libcudart.so: {PosixPath('/usr/local/cuda/lib64/libcudart.so')}
CUDA SETUP: PyTorch settings found: CUDA_VERSION=124, Highest Compute Capability: 8.6.
CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
CUDA SETUP: Required library version not found: libbitsandbytes_cuda124.so. Maybe you need to compile it from source?
CUDA SETUP: Defaulting to libbitsandbytes_cpu.so...

================================================ERROR=====================================
CUDA SETUP: CUDA detection failed! Possible reasons:
1. You need to manually override the PyTorch CUDA version. Please see: "https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
2. CUDA driver not installed
3. CUDA not installed
4. You have multiple conflicting CUDA libraries
5. Required library not pre-compiled for this bitsandbytes release!
CUDA SETUP: If you compiled from source, try again with `make CUDA_VERSION=DETECTED_CUDA_VERSION` for example, `make CUDA_VERSION=113`.
CUDA SETUP: The CUDA version for the compile might depend on your conda install. Inspect CUDA version via `conda list | grep cuda`.
================================================================================

CUDA SETUP: Something unexpected happened. Please compile from source:
git clone https://github.com/TimDettmers/bitsandbytes.git
cd bitsandbytes
CUDA_VERSION=124
python setup.py install
CUDA SETUP: Setup Failed!
Traceback (most recent call last):
  File "<frozen runpy>", line 189, in _run_module_as_main
  File "<frozen runpy>", line 148, in _get_module_details
  File "<frozen runpy>", line 112, in _get_module_details
  File "/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/__init__.py", line 6, in <module>
    from . import cuda_setup, utils, research
  File "/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/research/__init__.py", line 1, in <module>
    from . import nn
  File "/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/research/nn/__init__.py", line 1, in <module>
    from .modules import LinearFP8Mixed, LinearFP8Global
  File "/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/research/nn/modules.py", line 8, in <module>
    from bitsandbytes.optim import GlobalOptimManager
  File "/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/optim/__init__.py", line 6, in <module>
    from bitsandbytes.cextension import COMPILED_WITH_CUDA
  File "/home/aaaa/miniforge3/envs/unsloth/lib/python3.11/site-packages/bitsandbytes/cextension.py", line 20, in <module>
    raise RuntimeError('''
RuntimeError: 
        CUDA Setup failed despite GPU being available. Please run the following command to get more information:

        python -m bitsandbytes

        Inspect the output of the command and see if you can locate CUDA libraries. You might need to add them
        to your LD_LIBRARY_PATH. If you suspect a bug, please take the information from python -m bitsandbytes
        and open an issue at: https://github.com/TimDettmers/bitsandbytes/issues

here is my conda list

# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge  
_openmp_mutex             4.5                       2_gnu  
accelerate                1.6.0                    pypi_0    pypi
aiohappyeyeballs          2.6.1                    pypi_0    pypi
aiohttp                   3.11.16                  pypi_0    pypi
aiosignal                 1.3.2                    pypi_0    pypi
airportsdata              20250224                 pypi_0    pypi
annotated-types           0.7.0                    pypi_0    pypi
anyio                     4.9.0                    pypi_0    pypi
astor                     0.8.1                    pypi_0    pypi
asttokens                 3.0.0                    pypi_0    pypi
attrs                     25.3.0                   pypi_0    pypi
bitsandbytes              0.42.0                   pypi_0    pypi
blake3                    1.0.4                    pypi_0    pypi
bzip2                     1.0.8                h4bc722e_7  
ca-certificates           2025.1.31            hbcca054_0  
cachetools                5.5.2                    pypi_0    pypi
certifi                   2025.1.31                pypi_0    pypi
charset-normalizer        3.4.1                    pypi_0    pypi
click                     8.1.8                    pypi_0    pypi
cloudpickle               3.1.1                    pypi_0    pypi
comm                      0.2.2                    pypi_0    pypi
compressed-tensors        0.9.2                    pypi_0    pypi
cupy-cuda12x              13.4.1                   pypi_0    pypi
cut-cross-entropy         25.1.1                   pypi_0    pypi
datasets                  3.5.0                    pypi_0    pypi
debugpy                   1.8.13                   pypi_0    pypi
decorator                 5.2.1                    pypi_0    pypi
depyf                     0.18.0                   pypi_0    pypi
diffusers                 0.32.2                   pypi_0    pypi
dill                      0.3.8                    pypi_0    pypi
diskcache                 5.6.3                    pypi_0    pypi
distro                    1.9.0                    pypi_0    pypi
dnspython                 2.7.0                    pypi_0    pypi
docstring-parser          0.16                     pypi_0    pypi
einops                    0.8.1                    pypi_0    pypi
email-validator           2.2.0                    pypi_0    pypi
executing                 2.2.0                    pypi_0    pypi
fastapi                   0.115.12                 pypi_0    pypi
fastapi-cli               0.0.7                    pypi_0    pypi
fastrlock                 0.8.3                    pypi_0    pypi
filelock                  3.18.0                   pypi_0    pypi
frozenlist                1.5.0                    pypi_0    pypi
fsspec                    2024.12.0                pypi_0    pypi
gguf                      0.10.0                   pypi_0    pypi
h11                       0.14.0                   pypi_0    pypi
hf-transfer               0.1.9                    pypi_0    pypi
httpcore                  1.0.7                    pypi_0    pypi
httptools                 0.6.4                    pypi_0    pypi
httpx                     0.28.1                   pypi_0    pypi
huggingface-hub           0.30.1                   pypi_0    pypi
idna                      3.10                     pypi_0    pypi
importlib-metadata        8.6.1                    pypi_0    pypi
interegular               0.3.3                    pypi_0    pypi
ipykernel                 6.29.5                   pypi_0    pypi
ipython                   9.0.2                    pypi_0    pypi
ipython-pygments-lexers   1.1.1                    pypi_0    pypi
jedi                      0.19.2                   pypi_0    pypi
jinja2                    3.1.6                    pypi_0    pypi
jiter                     0.9.0                    pypi_0    pypi
jsonschema                4.23.0                   pypi_0    pypi
jsonschema-specifications 2024.10.1                pypi_0    pypi
jupyter-client            8.6.3                    pypi_0    pypi
jupyter-core              5.7.2                    pypi_0    pypi
lark                      1.2.2                    pypi_0    pypi
ld_impl_linux-64          2.43                 h712a8e2_4  
libexpat                  2.7.0                h5888daf_0  
libffi                    3.4.6                h2dba641_1  
libgcc                    14.2.0               h767d61c_2  
libgcc-ng                 14.2.0               h69a702a_2  
libgomp                   14.2.0               h767d61c_2  
liblzma                   5.6.4                hb9d3cd8_0  
libnsl                    2.0.1                hd590300_0  
libsqlite                 3.49.1               hee588c1_2  
libuuid                   2.38.1               h0b41bf4_0  
libxcrypt                 4.4.36               hd590300_1  
libzlib                   1.3.1                hb9d3cd8_2  
llguidance                0.7.11                   pypi_0    pypi
llvmlite                  0.43.0                   pypi_0    pypi
lm-format-enforcer        0.10.11                  pypi_0    pypi
markdown-it-py            3.0.0                    pypi_0    pypi
markupsafe                3.0.2                    pypi_0    pypi
matplotlib-inline         0.1.7                    pypi_0    pypi
mdurl                     0.1.2                    pypi_0    pypi
mistral-common            1.5.4                    pypi_0    pypi
mpmath                    1.3.0                    pypi_0    pypi
msgpack                   1.1.0                    pypi_0    pypi
msgspec                   0.19.0                   pypi_0    pypi
multidict                 6.3.1                    pypi_0    pypi
multiprocess              0.70.16                  pypi_0    pypi
ncurses                   6.5                  h2d0b736_3  
nest-asyncio              1.6.0                    pypi_0    pypi
networkx                  3.4.2                    pypi_0    pypi
ninja                     1.11.1.4                 pypi_0    pypi
numba                     0.60.0                   pypi_0    pypi
numpy                     1.26.4                   pypi_0    pypi
nvidia-cublas-cu12        12.4.5.8                 pypi_0    pypi
nvidia-cuda-cupti-cu12    12.4.127                 pypi_0    pypi
nvidia-cuda-nvrtc-cu12    12.4.127                 pypi_0    pypi
nvidia-cuda-runtime-cu12  12.4.127                 pypi_0    pypi
nvidia-cudnn-cu12         9.1.0.70                 pypi_0    pypi
nvidia-cufft-cu12         11.2.1.3                 pypi_0    pypi
nvidia-curand-cu12        10.3.5.147               pypi_0    pypi
nvidia-cusolver-cu12      11.6.1.9                 pypi_0    pypi
nvidia-cusparse-cu12      12.3.1.170               pypi_0    pypi
nvidia-cusparselt-cu12    0.6.2                    pypi_0    pypi
nvidia-nccl-cu12          2.21.5                   pypi_0    pypi
nvidia-nvjitlink-cu12     12.4.127                 pypi_0    pypi
nvidia-nvtx-cu12          12.4.127                 pypi_0    pypi
openai                    1.70.0                   pypi_0    pypi
opencv-python-headless    4.11.0.86                pypi_0    pypi
openssl                   3.4.1                h7b32b05_0  
outlines                  0.1.11                   pypi_0    pypi
outlines-core             0.1.26                   pypi_0    pypi
packaging                 24.2                     pypi_0    pypi
pandas                    2.2.3                    pypi_0    pypi
parso                     0.8.4                    pypi_0    pypi
partial-json-parser       0.2.1.1.post5            pypi_0    pypi
peft                      0.15.1                   pypi_0    pypi
pexpect                   4.9.0                    pypi_0    pypi
pillow                    11.1.0                   pypi_0    pypi
pip                       25.0.1             pyh8b19718_0  
platformdirs              4.3.7                    pypi_0    pypi
prometheus-client         0.21.1                   pypi_0    pypi
prometheus-fastapi-instrumentator 7.1.0                    pypi_0    pypi
prompt-toolkit            3.0.50                   pypi_0    pypi
propcache                 0.3.1                    pypi_0    pypi
protobuf                  3.20.3                   pypi_0    pypi
psutil                    7.0.0                    pypi_0    pypi
ptyprocess                0.7.0                    pypi_0    pypi
pure-eval                 0.2.3                    pypi_0    pypi
py-cpuinfo                9.0.0                    pypi_0    pypi
pyarrow                   19.0.1                   pypi_0    pypi
pycountry                 24.6.1                   pypi_0    pypi
pydantic                  2.11.1                   pypi_0    pypi
pydantic-core             2.33.0                   pypi_0    pypi
pygments                  2.19.1                   pypi_0    pypi
python                    3.11.11         h9e4cc4f_2_cpython  
python-dateutil           2.9.0.post0              pypi_0    pypi
python-dotenv             1.1.0                    pypi_0    pypi
python-json-logger        3.3.0                    pypi_0    pypi
python-multipart          0.0.20                   pypi_0    pypi
pytz                      2025.2                   pypi_0    pypi
pyyaml                    6.0.2                    pypi_0    pypi
pyzmq                     26.3.0                   pypi_0    pypi
ray                       2.44.1                   pypi_0    pypi
readline                  8.2                  h8c095d6_2  
referencing               0.36.2                   pypi_0    pypi
regex                     2024.11.6                pypi_0    pypi
requests                  2.32.3                   pypi_0    pypi
rich                      14.0.0                   pypi_0    pypi
rich-toolkit              0.14.1                   pypi_0    pypi
rpds-py                   0.24.0                   pypi_0    pypi
safetensors               0.5.3                    pypi_0    pypi
scipy                     1.15.2                   pypi_0    pypi
sentencepiece             0.2.0                    pypi_0    pypi
setuptools                75.8.2             pyhff2d567_0  
shellingham               1.5.4                    pypi_0    pypi
shtab                     1.7.1                    pypi_0    pypi
six                       1.17.0                   pypi_0    pypi
sniffio                   1.3.1                    pypi_0    pypi
stack-data                0.6.3                    pypi_0    pypi
starlette                 0.46.1                   pypi_0    pypi
sympy                     1.13.1                   pypi_0    pypi
tiktoken                  0.9.0                    pypi_0    pypi
tk                        8.6.13          noxft_h4845f30_101  
tokenizers                0.21.1                   pypi_0    pypi
torch                     2.6.0                    pypi_0    pypi
torchaudio                2.6.0                    pypi_0    pypi
torchvision               0.21.0                   pypi_0    pypi
tornado                   6.4.2                    pypi_0    pypi
tqdm                      4.67.1                   pypi_0    pypi
traitlets                 5.14.3                   pypi_0    pypi
transformers              4.50.0.dev0              pypi_0    pypi
triton                    3.2.0                    pypi_0    pypi
trl                       0.15.2                   pypi_0    pypi
typeguard                 4.4.2                    pypi_0    pypi
typer                     0.15.2                   pypi_0    pypi
typing-extensions         4.13.0                   pypi_0    pypi
typing-inspection         0.4.0                    pypi_0    pypi
tyro                      0.9.18                   pypi_0    pypi
tzdata                    2025.2                   pypi_0    pypi
unsloth                   2025.3.19                pypi_0    pypi
unsloth-zoo               2025.3.17                pypi_0    pypi
urllib3                   2.3.0                    pypi_0    pypi
uvicorn                   0.34.0                   pypi_0    pypi
uvloop                    0.21.0                   pypi_0    pypi
vllm                      0.8.2                    pypi_0    pypi
watchfiles                1.0.4                    pypi_0    pypi
wcwidth                   0.2.13                   pypi_0    pypi
websockets                15.0.1                   pypi_0    pypi
wheel                     0.45.1             pyhd8ed1ab_1  
xformers                  0.0.29.post2             pypi_0    pypi
xgrammar                  0.1.16                   pypi_0    pypi
xxhash                    3.5.0                    pypi_0    pypi
yarl                      1.18.3                   pypi_0    pypi
zipp                      3.21.0                   pypi_0    pypi