Live data from Hacker News

On-Device Acceleration of Large Diffusion Models

arxiv.org

1–4 of 4 posts

Re: On-Device Acceleration of Large Diffusion Models

#3
post #2

> Google LLC Now we are talking. Stable Diffusion getting some assistance in on-device usage. Won't be surprised to see Apple join in.

Apple ported SD to CoreML almost immediately, and pushed it to Github!

That being said, they havent really turned it into a product.

Re: On-Device Acceleration of Large Diffusion Models

#4
post #2

> Google LLC Now we are talking. Stable Diffusion getting some assistance in on-device usage. Won't be surprised to see Apple join in.

Apple ported SD to CoreML almost immediately, and pushed it to Github! That being said, they havent really turned it into a product.

> That being said, they havent really turned it into a product.

I don't think they need to, since they are also AI shovel makers due to their Apple Silicon chips.

So I guess that they will push for on-device LLMs soon. Won't be surprising to see that on iPhones and Macs.