Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stable Diffusion with Core ML on Apple Silicon

machinelearning.apple.com

Post reply on HN
Print view View original

171–180 of 184 posts

Re: Stable Diffusion with Core ML on Apple Silicon

#171

Post by throwaway675309 »

Cyberdog wrote: post #158
yboris wrote: post #56

Earlier quoted context omitted.

I'm baffled by continued hate on Electron. The option isn't between Electron and a lean OS-native application, but between Electron and nothing. I can build an Electron app in under a day with a pretty UI. It would take me several months to get anything sensible that is OS native. And I'm not going to sit down and learn the alternative. So please just say "thank you" to the developers that are sharing free things wit…

I would argue that shipping bad software is worse than shipping no software at all, yes. And it's impossible not to create bad software when you start with "it runs in a web browser, but it's not a web page." I say this as a web developer with over fifteen years of professional experience. Worst of all is the shamelessness, though. Don't Electron developers feel ashamed when they ship their products? Or have their br…

Developers just like any other inventive field have to balance time and work towards a good product.

Just because the app is written using a chromium framework does not necessarily mean that it's written poorly, VS code is a great example of a fast performance application written in electron.

I don't know where you're getting 2 GB of required memory but if you spin up an electron app it's rare that it requires more than 100 if it's not doing anything.

If you knew anything about these types of stable diffusion interfaces you know that they basically have to load the entire model into memory so that's likely where the multiple gigabytes is coming from.

A lot of us got into development work because we want to create new things, you sound more like the person who spends 99% of their time endlessly optimizing the game engine without actually remembering to build a compelling game experience.

You're getting downvoted because your arrogant tone makes you sound like an insufferable bore.

Re: Stable Diffusion with Core ML on Apple Silicon

#172

Post by philsnow »

philsnow wrote: post #167
alexfromapex wrote: post #42

Earlier quoted context omitted.

All I had to do was: - create a virtual environment (Python 3.8.15 worked best) - upgrade pip - pip install wheel - pip install -r requirements.txt - and then, python setup.py install - Had to update my XCode to use the generated mlpackage files :/ - Expand drawer with instructions and follow them to download model and convert it to Core ML format - Run their CLI command as mentioned

> Had to update my XCode to use the generated mlpackage files :/ I keep running into this, message is RuntimeError: Error compiling model: "Error reading protobuf spec. validator error: The model supplied is of version 7, intended for a newer version of Xcode. This version of Xcode supports model version 6 or earlier.". I upgraded XCode, tried re-installing the command line tools with various invocations of `sudo rm…

I'm past the edit window, but: I'm a dope, I didn't see the quite clear "macos 13 or newer" requirement.

Re: Stable Diffusion with Core ML on Apple Silicon

#173

Post by astrange »

pmarreck wrote: post #133
astrange wrote: post #130

Earlier quoted context omitted.

This is sort of like if you learned English from reading a book and the author said they owned all your English sentences after that. Of course you can see the original images ( https://rom1504.github.io/clip-retrieval/ ), it was legal to collect them (they used robots.txt for consent just like Google Image Search) and it was legal to do this with them (but not using US legal principles since it's made in Germany). "…

> future artists having their jobs taken by AIs that's simply not going to happen. as in every technological development so far, this is just another tool. 1) artists create the styles out of thin air 2) artists create the images out of thin air 3) computers are just collectors of this data and do not actually originate anything new. they are just very clever copycats. you're looking at an artist tool more than anyth…

> that's simply not going to happen.

I don't think it will either, but artists think it will, so it's strange that their proposed solution "credit the original artists behind AI models" won't solve the problem they have with it.

Re: Stable Diffusion with Core ML on Apple Silicon

#174

Post by astrange »

l33tman wrote: post #121
astrange wrote: post #46

Earlier quoted context omitted.

You can do anything you want. SD2 wasn’t “neutered”, the piece of it from OpenAI that knew a lot of artist names but wasn’t reproduceable was replaced with a new one from Stability that doesn’t. You can fine-tune anything you want back in.

The training-set was nerfed really good as well, it wasn't just OpenCLIP that was replaced. They will successively re-admit more training data during the 2.x releases I guess.

Yes, they removed some NSFW which might've hurt it, but releasing models that can generate CP /will/ get you in legal trouble.

The "in the style of Greg Rutkowski" prompts from SD1 though, IIRC, were thought to be proof it was reproducing the training set. But it actually only saw ~27 images of his, and the rest was residual biases from CLIP.

Re: Stable Diffusion with Core ML on Apple Silicon

#175

Post by astrange »

rowanG077 wrote: post #139
pmarreck wrote: post #133

Earlier quoted context omitted.

> future artists having their jobs taken by AIs that's simply not going to happen. as in every technological development so far, this is just another tool. 1) artists create the styles out of thin air 2) artists create the images out of thin air 3) computers are just collectors of this data and do not actually originate anything new. they are just very clever copycats. you're looking at an artist tool more than anyth…

Artist most definitely don't create images/styles out of thin air. No human can creatively create anything out of thin air.

Humans have access to much better thinking abilities than art AIs do.

e.g. SD2 prompted with "not a cat" produces a cat, and "1 + 1" doesn't produce "2".

Re: Stable Diffusion with Core ML on Apple Silicon

#176

Post by astrange »

idiotsecant wrote: post #165
rowanG077 wrote: post #160

Earlier quoted context omitted.

Creating something novel is not even remotely the same as creating something out of thin air. Even the genius with an original thought only could come by that thought by being informed through their life experiences. Not unlike an AI training set allowing an AI to create something novel.

Is creation coming about by analysis of life experience somehow different from creation coming about by analysis of training data?

Yes, because it's multimodal, and because you can think of new things to look at and go out in the world to look at them.

Re: Stable Diffusion with Core ML on Apple Silicon

#177

Post by Terretta »

Cyberdog wrote: post #155
Terretta wrote: post #90

Earlier quoted context omitted.

> finding conda to install seems to be its own process brew install miniconda brew comes from: /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)" Don't take my word for it, visit https://brew.sh .

I’m still stubbornly using MacPorts. If it ain’t broke… But given that the entire world of technical documentation assumes all technically-inclined people using Macs are using Homebrew, I’ll probably have to give up and switch over at some point. But not yet.

Grew up on BSD so I feel you. I'd say it became time to give in after they cleaned up need for su and put everything in opt.

In fact, if you used it before they cleaned all that up, or used it before moving from Intel to ARM and did a restore to the new arch instead of fresh install, it's worth doing a brew dump to a Brewfile, uninstalling ALL packages and brew, and reinstalling fresh on this side of the permissions and path cleanups.

- Migrate Homebrew from Intel Macs to Apple Silicon Macs:

- https://sparanoid.blog/749577

Re: Stable Diffusion with Core ML on Apple Silicon

#178

Post by nessus42 »

janandonly wrote: post #143
pmarreck wrote: post #134

Earlier quoted context omitted.

DiffusionBee is an app that is completely self-contained and lets you play with this stuff completely trivially, no installs required. https://diffusionbee.com/

But it's not optimised to work with Apple's CoreML (yet), isn't it?

It's pretty fast. On an 8GB M2 MacBook Air, it produces more than 2 images per minute using the default settings.

E.g., it's about 20x as fast as InvokeAI, which doesn't have an FP16 option that works on a Mac.

Re: Stable Diffusion with Core ML on Apple Silicon

#179

Post by astrange »

55555 wrote: post #140
astrange wrote: post #130

Earlier quoted context omitted.

This is sort of like if you learned English from reading a book and the author said they owned all your English sentences after that. Of course you can see the original images ( https://rom1504.github.io/clip-retrieval/ ), it was legal to collect them (they used robots.txt for consent just like Google Image Search) and it was legal to do this with them (but not using US legal principles since it's made in Germany). "…

The artist(s) are normally cited. Just download any Stable Diffusion -made image and look at the PNG info / metadata and you'll see "Greg Rutkowski" (lol) in the prompt.

That proves nothing except someone decided to say his name to an AI. He basically isn’t in SD’s training set! You can look it up.

It seems that he works coincidentally because CLIP associates his name with concept art.

Re: Stable Diffusion with Core ML on Apple Silicon

#180

Post by pmarreck »

janandonly wrote: post #143
pmarreck wrote: post #134

Earlier quoted context omitted.

DiffusionBee is an app that is completely self-contained and lets you play with this stuff completely trivially, no installs required. https://diffusionbee.com/

But it's not optimised to work with Apple's CoreML (yet), isn't it?

I don't know, but it seems extremely fast.
Post reply on HN