Fast-stable-diffusion colabs, +25% speed increase and memory efficient • Hacker News Board

Re: Fast-stable-diffusion colabs, +25% speed increase and memory efficient

#21

Post by eoerl » Tue, Sep 27, 2022, 7:00 AM UTC

whywhywhywhy wrote: post #5

Would be much better if these changes were a branch on the starting repo rather than entire refactors with many changes.

did you even peek at the link ? There's a PR on diffusers, and it's mentioned on the front page https://github.com/huggingface/diffusers/pull/532#issuecomme...

Re: Fast-stable-diffusion colabs, +25% speed increase and memory efficient

#22

Post by eoerl » Tue, Sep 27, 2022, 7:05 AM UTC

bloaf wrote: post #17

These guys claim a 50% speedup with a similar approach: https://www.reddit.com/r/StableDiffusion/comments/xmr3ic/spe...

yep, same approach but it arrived 3 days later and there's no mention of the [original PR](https://github.com/huggingface/diffusers/pull/532#issuecomme...), nice. Else the kernels used in that case -upstream flash attention- are not compatible with all nvidia GPU generations, FYI (xformers' cover a wider range and are generally faster or just pull Flash')

Re: Fast-stable-diffusion colabs, +25% speed increase and memory efficient

#23

Post by eoerl » Tue, Sep 27, 2022, 7:09 AM UTC

tgtweak wrote: post #12

any differences in output or they are identical with the same prompt and seed?

identical outputs, up to float computation shenanigans (not computed in the same order, strictly speaking)

Re: Fast-stable-diffusion colabs, +25% speed increase and memory efficient

#24

Post by deepserket » Tue, Sep 27, 2022, 9:22 AM UTC

nomel wrote: post #19

johnsimer wrote: post #8

Earlier quoted context omitted.

Run it on a burner Gmail account

How does one make a burner Gmail account these days? Last I tried, a unique phone number was required.

if your goal is to have an empty Drive you can reuse the same number to create a new account.

Edit: i just created a new account from my smartphone without a number