Stable Diffusion PR optimizes VRAM, generate 576x1280 images with 6 GB VRAM

Almost impossible to pinpoint what changed thanks to thousands of lines of completely irrelevant changes and shitty commit messages. It seems the only changeset that might be relevant out of +2,273 -1,531 is the +11 -7 from https://github.com/basujindal/stable-diffusion/pull/103/comm...? Does it even work?

Re: Stable Diffusion PR optimizes VRAM, generate 576x1280 images with 6 GB VRAM

#8

Post by [deleted] » Sun, Sep 04, 2022, 3:20 AM UTC

ceeplusplus wrote: post #4

Unfortunately the author of this PR decided to include garbage like this [1] in it, so this PR is pretty useless. [1] https://github.com/basujindal/stable-diffusion/pull/103/file...

[deleted]

Re: Stable Diffusion PR optimizes VRAM, generate 576x1280 images with 6 GB VRAM

#9

Post by kevingadd » Sun, Sep 04, 2022, 3:23 AM UTC

ceeplusplus wrote: post #4

Unfortunately the author of this PR decided to include garbage like this [1] in it, so this PR is pretty useless. [1] https://github.com/basujindal/stable-diffusion/pull/103/file...

You're still able to run it locally even if the license change prevents it from being merged, and it seems to be a proof of concept that may inspire other people to optimize it in different ways

Re: Stable Diffusion PR optimizes VRAM, generate 576x1280 images with 6 GB VRAM

#10

Post by frognumber » Sun, Sep 04, 2022, 3:24 AM UTC

temp_account_32 wrote: post #6

dr_dshiv wrote: post #5

How much VRAM was previously required?

I am able to generate a maximum resolution of 512x768 on my 11GB 1080Ti. This seems to use almost 100% of the available RAM.

That's weird. I cap out at 512x512 on my 16GB Ampere card. Even stepping down precision doesn't help. I wonder what's different.

I use it directly from Python.