enabling --medvram after installing xformers will increase the speed more

[TheLastBen]

Under windows it appears that enabling the --medvram (--optimized-turbo for other webuis) will increase the speed further. not so much under Linux though.

[ClashSAN]

Current commit: b458fa4

[DarkAlchy]

Under windows it appears that enabling the --medvram (--optimized-turbo for other webuis) will increase the speed further. not so much under Linux though.

Slowed mine down on W10.

[TheLastBen]

@DarkAlchy maybe you didn't install xformers correctly.

[DarkAlchy]

@DarkAlchy maybe you didn't install xformers correctly.

Installing requirements for Web UI
Launching Web UI with arguments: --xformers --port 9000
LatentDiffusion: Running in eps-prediction mode
DiffusionWrapper has 859.52 M params.
making attention of type 'vanilla' with 512 in_channels
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
making attention of type 'vanilla' with 512 in_channels
Loading weights [7460a6fa] from D:\stable-diffusion-webui\models\Stable-diffusion\model.ckpt
Global Step: 470000
Applying cross attention optimization. <---- Yep, it loaded it.
Model loaded.

[TheLastBen]

still, try and compile xformers to be sure
pip install git+https://github.com/neonsecret/xformers
it should take almost an hour

[DarkAlchy]

Successfully built xformers
Installing collected packages: xformers
Successfully installed xformers-0.0.14.dev0

[poudi7]

I enabled xformers, it automatically installed, since they added support for pascal gpu.
I’ve done some test on my gtx1070, on a batch size 8, 40step, euler a, I went from 01:59 to 01:57 with xformers.
When I add ––medvram in addition to xformers I get 02:17
Also I’m on windows

[DarkAlchy]

See that makes sense because lowvram, and medvram it swaps way more times than with at least 8 gigs of vram. That swapping is slow so it should slow it down.

[lolxdmainkaisemaanlu]

does xformers work in colab? I tried --xformers but it said no module found and ignored it... does colab's GPU support xformers?

[TheLastBen]

These colabs are all based on xformers : https://github.com/TheLastBen/fast-stable-diffusion