On a related note, has anyone been able to utilize Apple silicon GPUs? Running CPU-only is incredibly slow (and sad, since i've got these Apple accelerators idle!)
Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
161–170 of 184 posts
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#162Awesome! Although I wish to see the intermediate denoised image instead of the progress bar. Just a suggestion.
This isn't recommended, the decoding takes as much time as processing next step. I learned it the hard way when I tried displaying the intermediate steps for debugging.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#163It works extremely fast on an iPad Pro M1 (kind of expected, but it's _impressive_) although the app is built as "iPhone only", and strangely enough the iPad is cropping the upscaled iPhone app so the lower bar of image controls don't show at all, which is a pity
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#164Fantastic! Can it be made available for iPad?
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#165here's a direct app store link, if anyone wants to try the iPhone app immediately: https://apps.apple.com/us/app/draw-things-ai-generation/id64... congratulations to liuliu on the launch!
Crashes on my 13 Mini, which is unexpected! Anything we need to do to prep the phones?
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#166This is super cool. I just tried the default prompt on my iPhone 13 with the image size set to 768x512 and using the 3D Model (Redshift v1) and it just crashed the whole phone and restarted. Just like when I get BSOD's at work on my Windows GPU desktop :)
You should see a warning when selecting that size? 4GiB model cannot run at that resolution until someone implemented FlashAttention on Metal :)
Love the work, really great job!
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#167Earlier quoted context omitted.
SE 3rd Gen has 4GiB RAM, therefore the app defaults to 384x384 size. This is about 1/2 computation of your normal run (512x512) and the original version uses PLMS sampler, which defaults to 50 steps, while this one uses the newer DPM++ 2M Karras sampler, that defaults to 30 steps. All in all, your M1 Pro MBP is still 4x of your SE 3rd Gen in raw performance (although my implementation should be faster than PyTorch at…
> although my implementation should be faster than PyTorch at about 2x on M1 chips Do you plan to make a macOS version of your app also? Hope you will :)
I would also welcome the additional optimizations, however.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#168here's a direct app store link, if anyone wants to try the iPhone app immediately: https://apps.apple.com/us/app/draw-things-ai-generation/id64... congratulations to liuliu on the launch!
Crashes on my 13 Mini, which is unexpected! Anything we need to do to prep the phones?
I did have trouble closing the "adjustments" dialog (upper-right button) due to its close button being underneath the status bar, but found that I could just drag the dialog down to the bottom and it closed.
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#169Earlier quoted context omitted.
Crashes on my 13 Mini, which is unexpected! Anything we need to do to prep the phones?
I think that probably is to be expected, unfortunately. The model is 2GB; per the article iOS will kill apps that use 2GB on 4GB RAM devices (and the 13 Mini is 4GB).
Re: Stretch iPhone to its limit: 2GiB Stable Diffusion model runs locally on device
#170I wonder if any of these tricks would be applicable to make a version of Stable Diffusion which could run on the Steam Deck.