Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
1–10 of 184 posts
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#2This is cool and looks like a great way to drain my phone battery :)
I just used the prompt "A person looking at their phone in amazement" and got a good picture.
Beware that on startup the app downloads almost 2 gig of data.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#3Hahah now I can use my phone as a hand warmer this winter.
It's incredible that this is an app!
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#4This is incredible work and a tremendous achievement. Bravo and thanks for sharing.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#5Could in-memory compression used to bring down the RAM requirements?
There are some performance compressors like Blosch tuned for this:
https://www.blosc.org/pages/blosc-in-depth/
“Faster than memcpy” is the slogan.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#6This is cool and looks like a great way to drain my phone battery :) I just used the prompt "A person looking at their phone in amazement" and got a good picture. Beware that on startup the app downloads almost 2 gig of data.
It does warn you on startup about the download if you're not on wifi.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#7Could in-memory compression used to bring down the RAM requirements? There are some performance compressors like Blosch tuned for this: https://www.blosc.org/pages/blosc-in-depth/ “Faster than memcpy” is the slogan.
MacOS has transparent memory compression. Unclear to me if that's made its way to iPhone, but if it hasn't yet it will sooner or later.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#8This is cool and looks like a great way to drain my phone battery :) I just used the prompt "A person looking at their phone in amazement" and got a good picture. Beware that on startup the app downloads almost 2 gig of data.
(I have not downloaded it.)
Q: How long does a run typically take? 60 seconds?
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#9This is cool and looks like a great way to drain my phone battery :) I just used the prompt "A person looking at their phone in amazement" and got a good picture. Beware that on startup the app downloads almost 2 gig of data.
(I have not downloaded it.) Q: How long does a run typically take? 60 seconds?
From the link:
> It took a minute to summon the picture on the latest and greatest iPhone 14 Pro, uses about 2GiB in-app memory, and requires you to download about 2GiB data to get started. Even though the app itself is rock solid, given these requirements, I would probably call it barely usable.
also
> Even if it took a minute to paint one image, now my Camera Roll is filled with drawings from this app. It is an addictive endeavor. More than that, I am getting better at it. If the face is cropped, now I know how to use the inpainting model to fill it in. If the inpainting model doesn’t do its job, you can always use a paint brush to paint it over and do an image-to-image generation again focused in that area.
Seems very worth a try. I'm downloading the model right now, it's going a bit slow, ~2MB/s.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#10Could in-memory compression used to bring down the RAM requirements? There are some performance compressors like Blosch tuned for this: https://www.blosc.org/pages/blosc-in-depth/ “Faster than memcpy” is the slogan.
MacOS has transparent memory compression. Unclear to me if that's made its way to iPhone, but if it hasn't yet it will sooner or later.
Memory compression? I can't find any good resources to read about it, any hints? I'm having trouble imaging how could it possibly work without totally destroying performance.