Could in-memory compression used to bring down the RAM requirements? There are some performance compressors like Blosch tuned for this: https://www.blosc.org/pages/blosc-in-depth/ “Faster than memcpy” is the slogan.
Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
71–80 of 184 posts
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#72I wonder if any of these tricks would be applicable to make a version of Stable Diffusion which could run on the Steam Deck.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#73Earlier quoted context omitted.
I wonder why the file can’t be distributed inside the app on the App Store. That way downloads would be much more convenient.
Is P2P torrent type of sharing the load possible under AppStore guidelines (be they iOS or Android)? I've honestly never even thought about this being a thing, but with large shared data that doesn't change, why not?
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#74Any tips on how you “ If the face is cropped, now I know how to use the inpainting model to fill it in. If the inpainting model doesn’t do its job, you can always use a paint brush to paint it over and do an image-to-image generation again focused in that area.” using the app?
(Note that at that time, there is an implemention bug in inpainting model that caused the weirdness that I need to manually fix)
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#75Earlier quoted context omitted.
I wonder why the file can’t be distributed inside the app on the App Store. That way downloads would be much more convenient.
Is P2P torrent type of sharing the load possible under AppStore guidelines (be they iOS or Android)? I've honestly never even thought about this being a thing, but with large shared data that doesn't change, why not?
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#76Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#77Could in-memory compression used to bring down the RAM requirements? There are some performance compressors like Blosch tuned for this: https://www.blosc.org/pages/blosc-in-depth/ “Faster than memcpy” is the slogan.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#78Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#79Earlier quoted context omitted.
MacOS has transparent memory compression. Unclear to me if that's made its way to iPhone, but if it hasn't yet it will sooner or later.
My guess is that iPhone is purely “kill app” instead of “compress memory / swap” OOM model. This makes more sense for mobile.
[1] https://github.com/apple-oss-distributions/xnu/blob/bb611c8f...
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#80I gave this and other available applications a try and I don’t understand what people see in ai image generation.
A simple prompt generated a person with 3 nostrils, 7 squished fingers, deformities everywhere I look, it just mashes a bunch of photographs together and generates abominations.
Pay close attention to generated models and you will find details which are simply wrong.
What is the use case that I’m missing?