Exceedingly slow speed on 4060 Laptop....

[Frankthetank02-rgb]

RTX 4060 with 16GB RAM. I know this is a low-end machine for video generation but over 40 mins for one sec? People's 3060s are faster than this. Is there a way to optimize?

[Frankthetank02-rgb]

GPU usage also not ideal.

[able2608]

What's your generation settings? Seems that you can decrease reserved VRAM to less than 6GB (default). Still I did not get the advertised speed on 3060 laptop. Not pretty sure how those guys got the number (5 second in 50 minutes compared to 1.5 hours and still not done).

[Frankthetank02-rgb]

What's your generation settings? Seems that you can decrease reserved VRAM to less than 6GB (default). Still I did not get the advertised speed on 3060 laptop. Not pretty sure how those guys got the number (5 second in 50 minutes compared to 1.5 hours and still not done).

All default settings rn, could it be due to outdated CUDA in the pack

[able2608]

All default settings rn, could it be due to outdated CUDA in the pack

Doesn't seems like the problem. If you'd like to optimize on VRAM usage, decrease the reserved VRAM size seems to be the only way.
BTW it seems that the current resource management system is home-made by the author and not the diffusers' inplementation. This can be the reason for the slower speed. I might try to implement diffusers' layer offload to see if it is different.

[othneildrew]

I also have ridiculously show speeds for some reason with a decently spec'd pc. Running a RX 3050, 12th gen i9-12900K, 64 gb memory
Been running for 1.4 hrs now (and going) and it only recently showed the 1 sec preview.

😢

[Frankthetank02-rgb]

I also have ridiculously show speeds for some reason with a decently spec'd pc. Running a RX 3050, 12th gen i9-12900K, 64 gb memory Been running for 1.4 hrs now (and going) and it only recently showed the 1 sec preview.

😢

Reinstalled Python(even though supposedly this uses its own built-in environment) and sage, turned on teacache and now at approx. 44s/it. Still slow and nowhere near advertised speed but slightly better

[thorsil]

I'm in the same boat. I'm on a RTX 3060 and still doing about 1 second every 45 mins. I've been messing around with the sliders but haven't noticed much change yet.

[oscarchuncha]

I guess the advertised speed is only for gpus with 16gb minimum, this assumption is based on the different posts I have come accross on reddit pages. Any vram below this, I think it takes more time than wan 2.1 safetensor file

[lllyasviel]

Hi people - if you get unreasonably slow (if more than 2x slower than my tests) speed then it is possible that (1) your memory speed is bottlenecked, or (2) your swap memory is bottlenecked.

Usually (2) is more common than (1).

to solve (1), you take a look at your memory speed - if your system memory is too old, consider get a newer one. I believe my laptop is using like this. one can use something older but if too old or low end then it may cause bottleneck.

to solve (2), take the below steps:

1. look at this Image and find out whether the main swap is using HDD or SSD. If it is using HDD then you may want to change the setting to force the swap to use SSD.

2. if the swap is already using SSD, then make sure that the used disk has at least 100GB free space.

3. if this does not work then the bottleneck is in the SSD, maybe the SSD is too old or low end.

4. If the SSD is new and good but you still have problem, then it maybe bottlenecked by motherboard, but this is not very common.

also the speed reported in the first iteration is not accurate. it will drop after some warmup.

[MarklarMarklar]

I can get 48sec/it on a 3060 laptop GPU with 6GB VRAM. I'm just using the default parameters with teacache turned on.

[able2608]

Moved the program to another drive and the speed is now much bearable (~45sec/frame). Seems that hard drive speed plays a large factor if you do not have the VRAM to stuff all the things in. Would definitely suggest anyone with slower speeds to try other drives lying around.

However, I still believes that the current implementation does not use swap and it simply loads the required parameters from the file. I used to have the whole folder on my D drive and when it is running what I saw was surging D drive utilization and nearly nothing from C drive. I currently configured swap to only be on C drive.

[furana93]

Loaded AutoencoderKLHunyuanVideo to cuda:0 as complete.

The next step to initialize after this is really slow like around 10 minute. Is it because I set my Virtual Ram to 32 GB? Will it be better if I use the "Automatically manage paging file size for all drivers"?

I have a 3060 6gb vram, 32gb ram.

[able2608]

Loaded AutoencoderKLHunyuanVideo to cuda:0 as complete.

The next step to initialize after this is really slow like around 10 minute. Is it because I set my Virtual Ram to 32 GB? Will it be better if I use the "Automatically manage paging file size for all drivers"?

I have a 3060 6gb vram, 32gb ram.

The current implementation seems to not be using tiled VAE decode, and with your setup it seems like it is just the norm. The 10-minute wait is just for decoding the diffused samples. Would be great if tiled VAE is implemented to speed up the process.

[othneildrew]

Hi people - if you get unreasonably slow (if more than 2x slower than my tests) speed then it is possible that (1) your memory speed is bottlenecked, or (2) your swap memory is bottlenecked.

Usually (2) is more common than (1).

to solve (1), you take a look at your memory speed - if your system memory is too old, consider get a newer one. I believe my laptop is using like this. one can use something older but if too old or low end then it may cause bottleneck.

to solve (2), take the below steps:

1. look at this Image and find out whether the main swap is using HDD or SSD. If it is using HDD then you may want to change the setting to force the swap to use SSD.
2. if the swap is already using SSD, then make sure that the used disk has at least 100GB free space.
3. if this does not work then the bottleneck is in the SSD, maybe the SSD is too old or low end.
4. If the SSD is new and good but you still have problem, then it maybe bottlenecked by motherboard, but this is not very common.

also the speed reported in the first iteration is not accurate. it will drop after some warmup.

This helped with debugging for me. Speeds are now comparable to what the readme says. It took about 9mins for each frame on a RTX 3050. I only have an SSD. My problem was that I was running on WSL2. This in itself shouldn't be a problem, but there's probably something wrong with how I enabled hardware acceleration because on previous tests the GPU wouldn't be under any significant load.

Hope this helps

[othneildrew]

Alr, last message lol

Out of curiousity I setup a cloud GPU server with the following specs:
1 GPU / 48 GB VRAM / 8 vCPU / 64 GB RAM

I was able to get around 1 frame every 1:29:00. So a 10 sec video took about 14 mins. This has a lot of potential!