Live data from Hacker News

Stable Diffusion with Core ML on Apple Silicon

machinelearning.apple.com

131–140 of 184 posts

Re: Stable Diffusion with Core ML on Apple Silicon

#131

What are some good resources to get into working with this and learning the basics around ML to get some fundamental understanding of how this works?

I found the blog posts by Jay Alammar to be particularly good. Here are my starting suggestions (in this order) — https://jalammar.github.io/illustrated-word2vec/ https://jalammar.github.io/illustrated-transformer/ https://jalammar.github.io/illustrated-bert/ https://jalammar.github.io/illustrated-stable-diffusion/

Re: Stable Diffusion with Core ML on Apple Silicon

#132
post #124

Earlier quoted context omitted.

> I think it's sad that Apple doesn't even give attribution to any of the authors. Pretty much like Stable Diffusion and the grifters using it in general and they will never credit the artists and images that they stole to generate these images.

Do your point is that Apple and those grifters are equally reputable? two wrongs don't make a right.

I'm neither defending Apple or the grifters using Stable Diffusion in my comment. Both are as bad as each other, giving no attribution or credit.

Re: Stable Diffusion with Core ML on Apple Silicon

#133
post #124

Earlier quoted context omitted.

> I think it's sad that Apple doesn't even give attribution to any of the authors. Pretty much like Stable Diffusion and the grifters using it in general and they will never credit the artists and images that they stole to generate these images.

This is sort of like if you learned English from reading a book and the author said they owned all your English sentences after that. Of course you can see the original images ( https://rom1504.github.io/clip-retrieval/ ), it was legal to collect them (they used robots.txt for consent just like Google Image Search) and it was legal to do this with them (but not using US legal principles since it's made in Germany). "…

> future artists having their jobs taken by AIs

that's simply not going to happen. as in every technological development so far, this is just another tool.

1) artists create the styles out of thin air

2) artists create the images out of thin air

3) computers are just collectors of this data and do not actually originate anything new. they are just very clever copycats.

you're looking at an artist tool more than anything. sure, it's an unconventional one and a threatening one, but that's been true of literally every technological development since the Industrial Revolution.

Re: Stable Diffusion with Core ML on Apple Silicon

#134

How come you always have to install some version of pytorch or tensor flow to run these ml models? When I'm only doing inference shouldn't there be easier ways of doing that, with automatic hardware selection etc. Why aren't models distributed in a standard format like onnx, and inference on different platforms solved once per platform?

DiffusionBee is an app that is completely self-contained and lets you play with this stuff completely trivially, no installs required.

https://diffusionbee.com/

Re: Stable Diffusion with Core ML on Apple Silicon

#135
post #100

Earlier quoted context omitted.

I mean, it is a legal time bomb in general[0], with a non-standard license that has special stipulations in an amendment. Do you really incur the weeks of lead time that it would take Legal to review the legality of redistributing this model? 0: https://github.com/CompVis/stable-diffusion/blob/main/LICENS...

Redistributing that model to end users that violate Attachment A seems like a minefield.

Not really. You're not responsible for how users use products you distribute. The license is passed along to them, they would be the ones violating it.

Re: Stable Diffusion with Core ML on Apple Silicon

#136

Earlier quoted context omitted.

This is sort of like if you learned English from reading a book and the author said they owned all your English sentences after that. Of course you can see the original images ( https://rom1504.github.io/clip-retrieval/ ), it was legal to collect them (they used robots.txt for consent just like Google Image Search) and it was legal to do this with them (but not using US legal principles since it's made in Germany). "…

> future artists having their jobs taken by AIs that's simply not going to happen. as in every technological development so far, this is just another tool. 1) artists create the styles out of thin air 2) artists create the images out of thin air 3) computers are just collectors of this data and do not actually originate anything new. they are just very clever copycats. you're looking at an artist tool more than anyth…

4) If computers get good enough at 1) or 2), then there'd be much bigger problems, and essentially all humans will become the starving artists.

Also, I'm not so sure that language models like SD, Imagen, GPT-3, PaLM are purely copycats. And I'm not so sure that most human artists are not mostly copycats either.

My suspicion is that there's much more overlap between how these models work and what artists do (and how humans think in general), but that we elevate creative work so much that it's difficult to admit the size of the overlap. The reason why I lean this way is because of the supposed role of language in the evolution of human cognition (https://en.m.wikipedia.org/wiki/Origin_of_language)

And the reason I'm not certain that the NN-based models are purely copycats is they have internal state; they can and do perform computations, invent algorithms, and can almost perform "reasoning". I'm very much a layperson but I found this "chains of thought" approach (https://ai.googleblog.com/2022/05/language-models-perform-re...) very interesting, where the reasoning task given to the model is much more explicit. My guess is that some iterative construction like this will be the way the reasoning ability of language/image models will improve.

But at a high level, the only thing we humans have going for us is the anthropic principle. Hopefully there's some magic going on in our brains that's so complicated and unlikely that no one will ever figure out how it works.

BTW, I am a layperson. I am just curious when we will all be killed off by our robot overlords.

Re: Stable Diffusion with Core ML on Apple Silicon

#137

Earlier quoted context omitted.

All hail Grand Perspective back in the day, not sure who is carrying the "what's wasting my disk space" torch for free these days. Edit: still alive! https://grandperspectiv.sourceforge.net/

ncdu is the best in my book. TUI, supports deletion of files and folders, and very simple to understand. GUI apps for this task like GP and the like are more visually complex than they need to be.

Good point!

One gotcha for me is ncdu2 going Zig and Zig dropping support for OS versions as Apple does.

Re: Stable Diffusion with Core ML on Apple Silicon

#138

Man, this takes a ton of room to do the CoreML conversions - ran out of space doing the unet conversion even though I started with 25GB free. Going on a delete spree to get it up to 50GB free before trying again.

All hail Grand Perspective back in the day, not sure who is carrying the "what's wasting my disk space" torch for free these days. Edit: still alive! https://grandperspectiv.sourceforge.net/

Just used this again on 3 different computers, including mine. Works fantastically still.

Found a >100GB accidental “livestream” recording on one computer. Would have taken forever to find what was taking up all the room otherwise.

Re: Stable Diffusion with Core ML on Apple Silicon

#139

Earlier quoted context omitted.

This is sort of like if you learned English from reading a book and the author said they owned all your English sentences after that. Of course you can see the original images ( https://rom1504.github.io/clip-retrieval/ ), it was legal to collect them (they used robots.txt for consent just like Google Image Search) and it was legal to do this with them (but not using US legal principles since it's made in Germany). "…

> future artists having their jobs taken by AIs that's simply not going to happen. as in every technological development so far, this is just another tool. 1) artists create the styles out of thin air 2) artists create the images out of thin air 3) computers are just collectors of this data and do not actually originate anything new. they are just very clever copycats. you're looking at an artist tool more than anyth…

Artist most definitely don't create images/styles out of thin air. No human can creatively create anything out of thin air.

Re: Stable Diffusion with Core ML on Apple Silicon

#140
post #124

Earlier quoted context omitted.

> I think it's sad that Apple doesn't even give attribution to any of the authors. Pretty much like Stable Diffusion and the grifters using it in general and they will never credit the artists and images that they stole to generate these images.

This is sort of like if you learned English from reading a book and the author said they owned all your English sentences after that. Of course you can see the original images ( https://rom1504.github.io/clip-retrieval/ ), it was legal to collect them (they used robots.txt for consent just like Google Image Search) and it was legal to do this with them (but not using US legal principles since it's made in Germany). "…

The artist(s) are normally cited. Just download any Stable Diffusion -made image and look at the PNG info / metadata and you'll see "Greg Rutkowski" (lol) in the prompt.
Post reply on HN