Live data from Hacker News

Running Stable Diffusion XL 1.0 in 298MB of RAM

github.com

31–40 of 166 posts

Re: Running Stable Diffusion XL 1.0 in 298MB of RAM

#32
post #19

Earlier quoted context omitted.

So this should be it for trying to regulate theft, right? If you can open a window without any tool other than your own body. It doesn't seem like it's possible to stop thefts without a totalitarian surveillance state (and barely event then!). Or same can be said about media "piracy". Or ransomwares. States have forever regulated things that are not possible to enforce purely technically.

no, this is a lousy analogy because there is a clear harm to others in the case of theft. we've tried regulating other difficult to regulate things where the harm is unclear or indirect (drugs being a good example) to no avail. your piracy example is better. consider that it's the rise of more convenient options (netflix and spotify) not some effective policy that curtailed the prevalence of piracy.

> consider that it's the rise of more convenient options (netflix and spotify) not some effective policy that curtailed the prevalence of piracy.

The turning point was earlier than Netflix or Spotify – it was the iTunes Store. It was such a dramatic shift, people labelled Steve Jobs as “the man who persuaded the world to pay for content”.

https://www.theguardian.com/media/organgrinder/2011/aug/28/s...

Re: Running Stable Diffusion XL 1.0 in 298MB of RAM

#34
post #13

Earlier quoted context omitted.

Not very environment-friendly, though.

2.5A 5V is not much power, and it would use considerably less when idling.

125 watt hours for a raspberry pi to generate an image in 10 hours compared to 7 watt hours for a 440W PC to run for 1 minute.

Re: Running Stable Diffusion XL 1.0 in 298MB of RAM

#38
post #3

Fascinating. The money quote: "OnnxStream can consume even 55x less memory than OnnxRuntime while being only 0.5-2x slower" The trade-off between (V)RAM use and inference time sounds like it could be advantageous in some scenarios, and not just when RAM is constrained like in the RPi case. I actually wonder if this weight unloading approach can be used to handle larger batch sizes in the same amount of RAM, in effect…

"0.5-2x slower" must be a typo on their part right? If something is 0.5x slower, then it is 2x faster. I assume they meant to say "1.5-2x slower".

Communication is hard. If they said "Takes 50% to 200% more time" it would have been clearer

Re: Running Stable Diffusion XL 1.0 in 298MB of RAM

#40

Earlier quoted context omitted.

2.5A 5V is not much power, and it would use considerably less when idling.

125 watt hours for a raspberry pi to generate an image in 10 hours compared to 7 watt hours for a 440W PC to run for 1 minute.

Is this for a regular Pi . The OP post is using a Pi Zero 2.

That is big though

Post reply on HN