Live data from Hacker News

Stable Diffusion with Core ML on Apple Silicon

machinelearning.apple.com

31–40 of 184 posts

Re: Stable Diffusion with Core ML on Apple Silicon

#31
post #12
post #2

Atila from Apple on the expected performance: > For distilled StableDiffusion 2 which requires 1 to 4 iterations instead of 50, the same M2 device should generate an image in https://twitter.com/atiorh/status/1598399408160342039

SD2 is the one that was neutered, right? Maybe a dumb question but can the old model still be run?

[deleted]

Re: Stable Diffusion with Core ML on Apple Silicon

#32

Earlier quoted context omitted.

Oh gosh that's an intimidating installation process. I'll be much more interested when I can just `brew install` a binary.

I could be wrong but I think part of the issue is this needs some large files for the trained dataset?

[deleted]

Re: Stable Diffusion with Core ML on Apple Silicon

#33

Earlier quoted context omitted.

Oh gosh that's an intimidating installation process. I'll be much more interested when I can just `brew install` a binary.

A bit different take is DiffusionBee, if you're curious to try it out in a GUI form. https://diffusionbee.com

does it use the optimised model for Apple chips?

Re: Stable Diffusion with Core ML on Apple Silicon

#34

This may sound naive, but what are some use cases of running SD models locally? If the free/cheap options exist (like running SD on powerful servers), then what's the advantage of this new method?

"Hey Siri, draw me a purple duck" and it all happens without an internet connection!

If you mean monetary usecases: Roughly something like Photoshop/Blender/UnrealEngine with ML plugins that are low latency, private, and $0 server hosting costs.

Re: Stable Diffusion with Core ML on Apple Silicon

#35

This may sound naive, but what are some use cases of running SD models locally? If the free/cheap options exist (like running SD on powerful servers), then what's the advantage of this new method?

Even with the slower pytorch implementation my M1 Pro MBP, which tops out at consuming ~100W of power, can generate a decent image in 30 seconds.

I'm not sure exactly what that costs me in terms of power, but it is assuredly less than any of these services charge for a single image generation.

Re: Stable Diffusion with Core ML on Apple Silicon

#36
post #3

https://github.com/apple/ml-stable-diffusion

Oh gosh that's an intimidating installation process. I'll be much more interested when I can just `brew install` a binary.

> Oh gosh that's an intimidating installation process

I'm not seeing any installation instructions on either link - what am I missing?

Re: Stable Diffusion with Core ML on Apple Silicon

#37
post #2

Atila from Apple on the expected performance: > For distilled StableDiffusion 2 which requires 1 to 4 iterations instead of 50, the same M2 device should generate an image in https://twitter.com/atiorh/status/1598399408160342039

Last nail in the coffin for DALL·E.

Not really, everyone will have their own flavor on how to rapidly train the model.

Dall-e et. al will still be able to bandwagon off of all the free ecosystem being built around the $10M SD1.4 model that is showing what is possible.

E.g. Dall-e could go straight to Hollywood if their model training works better than SD’s. The toolsets will work

Re: Stable Diffusion with Core ML on Apple Silicon

#38

Earlier quoted context omitted.

A bit different take is DiffusionBee, if you're curious to try it out in a GUI form. https://diffusionbee.com

does it use the optimised model for Apple chips?

Not yet, likely, but the project is very active. I could see it coming quite soon.

Re: Stable Diffusion with Core ML on Apple Silicon

#39

This may sound naive, but what are some use cases of running SD models locally? If the free/cheap options exist (like running SD on powerful servers), then what's the advantage of this new method?

Soon you will be able to render home imovies like they were edited by the team that made the dark knight (which costs ~$100k/min if done professionally).

Re: Stable Diffusion with Core ML on Apple Silicon

#40
post #14
post #2

Atila from Apple on the expected performance: > For distilled StableDiffusion 2 which requires 1 to 4 iterations instead of 50, the same M2 device should generate an image in https://twitter.com/atiorh/status/1598399408160342039

With the full 50 iterations it appears to be about 30s on M1. They have some benchmarks on the github repo: https://github.com/apple/ml-stable-diffusion For reference, previously I was getting about <3 minutes for 50 iterations on my Macbook Air M1. I haven't yet tried Apple's implementation but it looks like a huge improvement. It might take it from "possible" to "usable".

For comparison, it's also taking ~3min @ 50 iterations on my 12c Threadripper using OpenVino. It sounds like the improvements bring the M1 performance roughly in line with a GTX 1080.
Post reply on HN