Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

offload device and main device have a huge impact on lora #245

Open
wwwffbf opened this issue Jan 2, 2025 · 2 comments
Open

offload device and main device have a huge impact on lora #245

wwwffbf opened this issue Jan 2, 2025 · 2 comments

Comments

@wwwffbf
Copy link

wwwffbf commented Jan 2, 2025

I trained a character lora using diffusion pipe, and found in the default hunyuan video wraper workflow:
the offload device gives a better lora effect, while the main device deviates significantly from the lora training set.

I'm very confused. Does anyone know why

@kijai
Copy link
Owner

kijai commented Jan 2, 2025

It's possible the LoRa simply fails to load unless the model is initialized on offload device.

@wwwffbf
Copy link
Author

wwwffbf commented Jan 3, 2025

@kijai Thanks for the quick reply! should I always use the offload device instead of the main device?
I've found that both are basically the same speed with auto cpu offload turned off.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants