-
Notifications
You must be signed in to change notification settings - Fork 1
Closed
Description
PR #11 fixed the blocker, but generation is now running so slow its unusable - most likely falling back to CPU only.
Lets review the code and make sure its taking full advantage of Apple Meta GPU features and MPS.
If there are blockers, lets explore them together and find an elegant solution to achieve native speed generation on Apple Metal GPUs
Reactions are currently unavailable