Live data from Hacker News

Show HN: Run Stable Diffusion Directly on iPhone

apps.apple.com

21–30 of 50 posts

Re: Show HN: Run Stable Diffusion Directly on iPhone

#22
Testing on my iPhone 15 pro - I couldn't find it in the app store with a search but I looked up the developer and was able to download it there. Working so far, first image took a while (a few minutes, as the app warned me), but subsequent images were a bit faster (~1.5 minutes). Phone does get pretty warm though.

Re: Show HN: Run Stable Diffusion Directly on iPhone

#23

Testing on my iPhone 15 pro - I couldn't find it in the app store with a search but I looked up the developer and was able to download it there. Working so far, first image took a while (a few minutes, as the app warned me), but subsequent images were a bit faster (~1.5 minutes). Phone does get pretty warm though.

iPhone 15 Pro with 30 steps at 512x512 resolution (SD v1.5) should take around 35 seconds on iPhone 15 Pro with Draw Things. 1.5 mins are too slow. (I am the author of DT).

Re: Show HN: Run Stable Diffusion Directly on iPhone

#24

Earlier quoted context omitted.

1) Just how much space do you think a decent LLM takes up? "lol" indeed. 2) This is 2024. Phones aren't limited to 128K any more. The iPhone 15 Pro and Pro Max can be configured with up to 1 TB of storage. (no personal connection to this app... I just get tired of people on here gratuitously crapping on interesting stuff that other people have made)

> The iPhone 15 Pro and Pro Max can be configured with up to 1 TB of storage. On the flip side, apparently the base-model iPhone 15 Pro comes with zero storage upgrades. You get the same 128gb base-model storage as the regular 15, and the 256gb entry model is reserved for the Pro Max. A bit surprising, given that iPhones don't support expandable storage.

You can at least record video directly to an external USB drive.

Re: Show HN: Run Stable Diffusion Directly on iPhone

#26
post #23

Testing on my iPhone 15 pro - I couldn't find it in the app store with a search but I looked up the developer and was able to download it there. Working so far, first image took a while (a few minutes, as the app warned me), but subsequent images were a bit faster (~1.5 minutes). Phone does get pretty warm though.

iPhone 15 Pro with 30 steps at 512x512 resolution (SD v1.5) should take around 35 seconds on iPhone 15 Pro with Draw Things. 1.5 mins are too slow. (I am the author of DT).

It could indeed be faster. The app does not currently use the neural engine (ANE) because it has a tendency to crash the app, so it uses only CPU and GPU. The app also does upscaling, which adds ~10 seconds.

Re: Show HN: Run Stable Diffusion Directly on iPhone

#27
post #26
post #23

Earlier quoted context omitted.

iPhone 15 Pro with 30 steps at 512x512 resolution (SD v1.5) should take around 35 seconds on iPhone 15 Pro with Draw Things. 1.5 mins are too slow. (I am the author of DT).

It could indeed be faster. The app does not currently use the neural engine (ANE) because it has a tendency to crash the app, so it uses only CPU and GPU. The app also does upscaling, which adds ~10 seconds.

I am going to put model related code we use in a public repo soon (it is very similar to https://github.com/liuliu/swift-diffusion but in NHWC format). ANE will be around 25s if it runs. DT's default only uses GPUs and 35s is on GPU (yes, like you said, upscaling would take extra 10s).

Re: Show HN: Run Stable Diffusion Directly on iPhone

#30
Apple released CoreML Stable Diffusion library a little over a year ago [1]. Hugging Face released their version of the example app for the CoreML Stable Diffusion library [2].

The app should be able to run on iPhone 14 Pro, I believe the requirements is about 6-8Gb of RAM. And I was not able to run it on iPhone 13 Mini, because it has only 4Gb of RAM.

- [1] https://github.com/apple/ml-stable-diffusion

- [2] https://github.com/huggingface/swift-coreml-diffusers

Post reply on HN