This is amazing! Finally a use case for using all that compute power on the phone
This illustrates the beginning of use cases for computing/ML on the edge. The total power of all the phones and their sensors is mindblowing.
Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
141–150 of 184 posts
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#142This is amazing! Finally a use case for using all that compute power on the phone
This illustrates the beginning of use cases for computing/ML on the edge. The total power of all the phones and their sensors is mindblowing.
Some javascript crypto miners have been taking advantage of this for years now.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#143Update: Draw Things uses “One-time photo selection” which according to Settings > Privacy & Security > Photos “Even if your photos were recently shown to you to select from, the app did not have access to your photo library.” Still, I didn’t realize apps could save to Photos without explicitly asking permission.
I don’t recall giving “Draw Things” permissions to access my photo library, yet the app is able to save to my photo library without prompting and able to read existing images.
I may have misunderstood what permissions apps should ask for when saving to the photo library.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#144Earlier quoted context omitted.
I have generated some images, I think it only takes less than 1% of the battery for an image, this is already much better than most of the game(for having fun).
It took my battery from 80 to 77% for one generation on the default settings (384^2, 30 iterations). Less than a minute of compute time to complete a generation. Iphone battery health reports a battery at 100% health. This is an iphone SE3. Amazing how huge the difference in energy consumption is for the system in standby vs going full throttle. EDIT: I generated 3 more images; every subsequent generation reduced bat…
My iPhone 12 mini dropped from 76% to 71% and got noticeably warmer. Battery health is way worse than yours, 85%.
I wonder if generating a picture uses so much juice that it even drops the percentage while charging...
EDIT: Generating a picture while charging did not drop the percentage.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#145Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#146Earlier quoted context omitted.
It took my battery from 80 to 77% for one generation on the default settings (384^2, 30 iterations). Less than a minute of compute time to complete a generation. Iphone battery health reports a battery at 100% health. This is an iphone SE3. Amazing how huge the difference in energy consumption is for the system in standby vs going full throttle. EDIT: I generated 3 more images; every subsequent generation reduced bat…
My iPhone 12 mini dropped from 76% to 71% and got noticeably warmer. Battery health is way worse than yours, 85%. I wonder if generating a picture uses so much juice that it even drops the percentage while charging... EDIT: Generating a picture while charging did not drop the percentage.
I generated a bunch of pictures while charging and the percentage still went up (albeit slowly).
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#147Any tips on how you “ If the face is cropped, now I know how to use the inpainting model to fill it in. If the inpainting model doesn’t do its job, you can always use a paint brush to paint it over and do an image-to-image generation again focused in that area.” using the app?
I have a Twitter thread on this: https://twitter.com/liuliu/status/1587978815208407041?s=46&t... (Note that at that time, there is an implemention bug in inpainting model that caused the weirdness that I need to manually fix)
liuliu, this is simply incredible.
Were you focused on just making it work on the iPhone, or do you think you will keep adding functionalities to the app? Do you think it will ever be possible to train one's own model on an iPhone?
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#148Earlier quoted context omitted.
Early cars were terrible too, but here we are. The promise is that future versions of the technology will be able to draw anatomically correct people and images. A computer program that can do in mere minutes what takes a person hours. If you've never wanted a picture of something you can describe but aren't able to draw in your life, then there is no use case for you. For anyone else that's interacted with the world…
> Early cars were terrible too, but here we are. Were they? https://en.wikipedia.org/wiki/Benz_Patent-Motorwagen - as fast as a carriage, about the same stink. Carriages clearly had a usecase. Generated images now: take enormous energy to generate. Main current usecase is to gobble up more energy (mass media/entertainment).
And images have a clear use case. Stable Diffusion is effectively moving the horse under the hood.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#149Even though I understood very little of that it was still wild fun reading it. I'm glad such wizards exist, because I and most people I know certainly don't qualify.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#150Thanks, Ive been looking forward to something like this coming out. Runs great on my iPad but a UI optimised for the form factor would be nice.