You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi @soloist-tech , we've mainly tested on Ampere GPUs (A100s 40GB specifically) for training and finetuning. For inference, we also primarily use Ampere GPUs (A10s), however the community has gotten it to work with many other hardware. For example, see: ggerganov/ggml#145 from the GGML folks.
See title lol
The text was updated successfully, but these errors were encountered: