Live data from Hacker News

A Web UI for Stable Diffusion

github.com

61–70 of 148 posts

Re: A Web UI for Stable Diffusion

#61

I have a 6gb 1660ti, barely holding on. Is a new 12gb card good enough for now, or should I go even higher to be safe for a few years of sd innovation?

I'm using it with a 2070 (4 year old card with 8gb vram) and it takes about 5 seconds for a 512x512 image. It's been plenty fast to have some fun, but I think I'd want faster if it was part of a professional work flow.

im on my 2020 macbook air m1 ... 512px image takes 2-3 minutes :(

Re: A Web UI for Stable Diffusion

#62
post #49
post #48

Earlier quoted context omitted.

Midjourney uses SD under the hood (you can see in their license), but they augnment the model in various ways.

The results in midjourney are significantly better than SD. I find it much easier to get to a good result in MJ and I've been trying to understand why. Anymore insight you could share?

Midjourney is doing "secret sauce" post-processing to enhance the image returned from the model. SD just gives you back what the model spits out. That's how I understand it at least

Re: A Web UI for Stable Diffusion

#63
post #49
post #48

Earlier quoted context omitted.

Midjourney uses SD under the hood (you can see in their license), but they augnment the model in various ways.

The results in midjourney are significantly better than SD. I find it much easier to get to a good result in MJ and I've been trying to understand why. Anymore insight you could share?

Good engineering. Midjourney likely has a lot going on under the hood before your prompt actually gets to Stable Diffusion. As an example you can check out this research paper [0] which seeks to add prompt chaining to GPT-3 so you can "correct" it's outputs before it reaches back to the user. There's also no rule that states you can only make one call to SD, MJ likely bounces around a picture through a pipeline they've tuned to ensure your generated image looks more reasonable.

[0]: https://arxiv.org/abs/2110.01691

Re: A Web UI for Stable Diffusion

#64
post #17

So, and this is an ELI5 kind of question I suppose. There must be something going on like "processing a kazillion images" and I'm trying to wrap my head around how (or what part of) that work is "offloaded" to your home computer/graphics card? I just can't seem to make sense of how you can do it at home if you're not somehow in direct contact with "all the data?" e.g. must you be connected to the internet, or "stable…

A kazillion images are used to create/optimize a neural network (basically). What you're working with is the result of that training. These are the "weights"

Re: A Web UI for Stable Diffusion

#65
post #54

I’m waiting for someone to wrap this up into a desktop app that I can install and run on my Mac.

I’ve been working on a queue-centric desktop app GUI for SD: https://twitter.com/westoncb/status/1568114946235580418?s=46...

I plan to wrap things up and put out the source this weekend.

Re: A Web UI for Stable Diffusion

#66
post #41

Earlier quoted context omitted.

SD has 860M weights for the main workhorse part. At 16-bit precision that is only 1.6 GB of data, which in some very real sense has condensed the world's total knowledge of art and photography and styles and objects. It's not a search engine, it's self-contained and the closest analogy is that it's a very very knowledgable and skilled artist.

Is there a smaller version of the model available (<4gb) intended for use with 16 bit precision?

Diffusers shows how to use the fp16 variant.

https://github.com/huggingface/diffusers

Re: A Web UI for Stable Diffusion

#67
post #60
post #54

I’m waiting for someone to wrap this up into a desktop app that I can install and run on my Mac.

I've been looking into this for the last 2 days. Unless you're running an M1 Mac or newer, you're SOL. Stable Diffusion is built on PyTorch. PyTorch mainly has been designed to work with Nvidia cards. However PyTorch added support for something called RocM like a year ago that adds compatibility with newer AMD cards. Unfortunately RocM doesn't support slightly older AMD cards in conjunction with intel processors. So…

There is work on a CoreML version which may play nicer with older Macs w/sufficiently beefy dGPUs.

https://github.com/huggingface/diffusers/issues/443

Re: A Web UI for Stable Diffusion

#68
post #13

People recently figured out how to export stable diffusion to onnx so it’ll be exciting to see some actual web UIs for it soon (via quantized models and tfjs/onnxruntime for web)

Very cool! Can you link to where this is taking place? A commenter mentioned today it might be possible to pre-download the model and load it into the browser from the local filesystem rather than include such a gigantic blob as an accompanying dependency, fighting different caching RFC's, security/usage restrictions, and anything else that might inadvertently trigger a re-download. https://news.ycombinator.com/item?…

Support for ONNX export was just added to diffusers, but no runtime logic for scheduling yet.

https://github.com/huggingface/diffusers

Post reply on HN