Skip to content

Commit 8c9c416

Browse files
committed
doc warning re gpu_id not being overly predictable
1 parent 139d5f9 commit 8c9c416

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

docs/Using More GPUs.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,8 @@ There are two primary ways to use more GPUs:
77
## More GPUs In Your Machine
88

99
To use more GPUs in your machine, simply add more self-start backends (interface -> `Server` -> `Backends`), and increment the `GPU_ID` setting for each added backend.
10+
- Note, if you have mixed different GPUs, the IDs are not necessarily predictable, but they are consistent. Nvidia has acknowledged that the hardware order doesn't match the smi order: <https://forums.developer.nvidia.com/t/cuda-visible-devices-being-ignored/41808> *(This is annoying and I wish they'd fix it)*
11+
- So, test what GPU is actually used for each ID by triggering generations on each backend and watching usage. It will be consistent as long as you don't change pcie hardware.
1012

1113
## More Machines With GPUs
1214

0 commit comments

Comments
 (0)