In 260 megs of RAM?!? I'm going to try this on my Amiga! Check back in a few months for my results...
Look at moneybags over here with his "megs" of RAM. I think mine only had 256K available after the kickstart disk was loaded.
Running Stable Diffusion in 260MB of RAM
31–40 of 66 posts
Re: Running Stable Diffusion in 260MB of RAM
#32Earlier quoted context omitted.
There definitely are some: https://shop.pimoroni.com/search?q=e-ink And now I think I know what my next project is going to be, I am sure I can find some desk space
Yessss! I looked into building some self contained "slow tech" generative art using eink a couple of years ago but it was just impossible for my tiny budget. This is great, thanks!! Edit..: I'm so hyped about this; the example image on TFA takes +2 hours to generate, but who cares?! I'd love to have a little display that churns around in the background and creates a new variation on my prompt every whatever hours, di…
Is it possible to incorporate a personalized "context" into the generator? Weather, market/news sentiments, calendar events, etc... to style the end result.
Re: Running Stable Diffusion in 260MB of RAM
#33Earlier quoted context omitted.
Yessss! I looked into building some self contained "slow tech" generative art using eink a couple of years ago but it was just impossible for my tiny budget. This is great, thanks!! Edit..: I'm so hyped about this; the example image on TFA takes +2 hours to generate, but who cares?! I'd love to have a little display that churns around in the background and creates a new variation on my prompt every whatever hours, di…
Is it possible to incorporate a personalized "context" into the generator? Weather, market/news sentiments, calendar events, etc... to style the end result.
I love the idea.
Re: Running Stable Diffusion in 260MB of RAM
#34I like the use of a tiny device to generate the images. I was wondering whether the energy consumption per image would be lower, but I did the simple maths and it's not the case.
A raspberry pi zero 2W seems to use about 6W under load (source: https://www.cnx-software.com/2021/12/09/raspberry-pi-zero-2-... )
So if it takes 3 hours to generate one picture, that's about 18Wh per image.
A Nvidia Tesla or RTX GPU can generate a similar picture very quickly. Assuming one second per image and 350W under load for the whole system it's in the magnitude of 0.1Wh per image.
Of course we could consider that a raspberry pi zero uses a lot less ressources and energy to be manufactured and transported.
Re: Running Stable Diffusion in 260MB of RAM
#35I like the use of a tiny device to generate the images. I was wondering whether the energy consumption per image would be lower, but I did the simple maths and it's not the case. A raspberry pi zero 2W seems to use about 6W under load (source: https://www.cnx-software.com/2021/12/09/raspberry-pi-zero-2-... ) So if it takes 3 hours to generate one picture, that's about 18Wh per image. A Nvidia Tesla or RTX GPU can gen…
For on prem use, the up front cost is a lot lower. The A100 that most serious outfits are using runs in the thousands to tens of thousands of dollars per unit with very limited availability. The pi is typically under $75 usd for any variant.
Re: Running Stable Diffusion in 260MB of RAM
#36I like the use of a tiny device to generate the images. I was wondering whether the energy consumption per image would be lower, but I did the simple maths and it's not the case. A raspberry pi zero 2W seems to use about 6W under load (source: https://www.cnx-software.com/2021/12/09/raspberry-pi-zero-2-... ) So if it takes 3 hours to generate one picture, that's about 18Wh per image. A Nvidia Tesla or RTX GPU can gen…
For on prem use, the up front cost is a lot lower. The A100 that most serious outfits are using runs in the thousands to tens of thousands of dollars per unit with very limited availability. The pi is typically under $75 usd for any variant.
A RTX 4090 has a much better value for stable diffusion but yes if you start to think about cost the pi wins. If you think about availability, I’m not sure.
Re: Running Stable Diffusion in 260MB of RAM
#37Re: Running Stable Diffusion in 260MB of RAM
#38"It runs Stable Diffusion" is the new "It runs Doom".
Now I'm wondering: could a monkey hitting random keys on a keyboard for an infinite amount of time eventually come up with the right prompts to get GPT-4 to produce code that compiles to a faithful reproduction of Doom?
Re: Running Stable Diffusion in 260MB of RAM
#39Incredible! If only there was some cheap hackable eink frame, you could make a fully self contained artwork from eink panel + rpi that's (slowly) continuously updating itself..!
Like a continuously updating wall-mounted newspaper[1]?
[1] https://imgur.io/a/NoTr8XX (no, I don’t know why anyone would use Imgur to write up a hack either)
Re: Running Stable Diffusion in 260MB of RAM
#40In 260 megs of RAM?!? I'm going to try this on my Amiga! Check back in a few months for my results...
Look at moneybags over here with his "megs" of RAM. I think mine only had 256K available after the kickstart disk was loaded.
I splurged.