LD_LIBRARY_PATH environment variable is not set (linux question)

[joshgura]

what LD_LIBRARY_PATH in particular does kohya want? the general system libraries or the ones in the venv?

i noticed that in the gui.sh script, it is supposed to default to bash's path, but i found that if I specify LD_LIBRARY_PATH to point to kohya's own venv library locations that it works fine. i just wonder why the ld library path isn't automatically pointing to kohyas venv.

[Poukpalaova]

I just noticed also that when i try to lunch a training, the path to the python is the one from my library path (C:....users...) and not the one in the venv.

[joshgura]

after complete reinstall, and bitsandbytes unable to find any cuda libraries, in spite of them existing, i get this data from the bitsandbytes debug:

/home/username/kohya_ss/venv/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:183: UserWarning: :/home/username/kohya_ss/venv/lib/python3.10/site-packages/torch/lib/ did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0', 'libcudart.so.12.1', 'libcudart.so.12.2'] as expected! Searching further paths...
warn(msg)
The following directories listed in your path were found to be non-existent: {PosixPath('@/tmp/.ICE-unix/1340,unix/thing'), PosixPath('local/thing')}
The following directories listed in your path were found to be non-existent: {PosixPath('/org/freedesktop/DisplayManager/Session0')}
The following directories listed in your path were found to be non-existent: {PosixPath('/org/freedesktop/DisplayManager/Seat0')}
The following directories listed in your path were found to be non-existent: {PosixPath('https'), PosixPath('//debuginfod.archlinux.org ')}
CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths...
The following directories listed in your path were found to be non-existent: {PosixPath('/usr/local/cuda/lib64')}
DEBUG: Possible options found for libcudart.so: set()
CUDA SETUP: PyTorch settings found: CUDA_VERSION=118, Highest Compute Capability: 8.6.
CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md
CUDA SETUP: Loading binary /home/username/kohya_ss/venv/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda118.so...
libcusparse.so.11: cannot open shared object file: No such file or directory
CUDA SETUP: Problem: The main issue seems to be that the main CUDA runtime library was not detected.
CUDA SETUP: Solution 1: To solve the issue the libcudart.so location needs to be added to the LD_LIBRARY_PATH variable
CUDA SETUP: Solution 1a): Find the cuda runtime library via: find / -name libcudart.so 2>/dev/null
CUDA SETUP: Solution 1b): Once the library is found add it to the LD_LIBRARY_PATH: export

etc

I just installed comfyui using virtualenv and I noticed that libcublas was right inside that venv after installation, and comfy worked fine. I am wondering why after a fresh install of kohya that the cuda libraries aren't just automatically found in its own venv, and why its necessary to mess around with LD_LIBRARY_PATH at all. probably is unnecessary. it's not something i want to globally apply to my .bashrc. also, aliasing the LD_LIBRARY_PATH isn't working even if i put every possible library location for every instance of libcublas on my system onto that variable, because it will complain that it should be in .bashrc

i assume that all the requirements needed are in requirements.txt is that wrong?

shouldn't all the relevant libraries be installed at:

/kohya_ss/venv/lib/python3.10/site-packages/torch/lib

if not, is there some reason why they're not in there?