Live data from Hacker News

AI model for near-instant image creation on consumer-grade hardware

surrey.ac.uk

21–30 of 55 posts

Re: AI model for near-instant image creation on consumer-grade hardware

#21
My favorite test of image models:

Drawing of the inside of a cylinder.

That's usually bad enough. Then try to specify size, and specify things you want to place inside the cylinder relative to the specified size.

(e.g. try to approximate an O'Neill cylinder)

I love generative AI models, but they're really bad at that, and this one is no exception, but the speed makes playing around with prompt variations to try to see if I get somewhere a lot easier (I'm not getting anywhere...)

Re: AI model for near-instant image creation on consumer-grade hardware

#22

> Instant image generation that responds as users type – a first in the field Stable Diffusion Turbo has been able to do this for more than a year, even on my "mere" RTX 3080.

Notably, fal.ai used to host a demo here[1] that was very impressive at the time.

[1] https://fastsdxl.ai/

Re: AI model for near-instant image creation on consumer-grade hardware

#23

The models seem to have gotten to a point where even something I can run locally will give decent results in a reasonable time. What is currently "the best" (both from an output quality and ease of installation perspective) setup to just play with local a) image generation, b) image editing?

EasyDiffusion is almost completely download and run, i'm too lazy to setup comfyui, I just want to do model downloads -> run easy diffusion -> input my prompts into the web UI -> start cooking my poor graphics card

Re: AI model for near-instant image creation on consumer-grade hardware

#24
I wasn't able to get many decent results after playing with the demo for some time. I guess my question is...what exactly is this for? I was able to get substantially better results about 2 years ago running SD 2 locally on a gaming laptop. Sure, the images took 30 seconds or so each, but the quality was better than I could get in the demo. Not sure what the point of instantly generating a ton of bad quality images is.

What am I missing?

Re: AI model for near-instant image creation on consumer-grade hardware

#25
post #24

I wasn't able to get many decent results after playing with the demo for some time. I guess my question is...what exactly is this for? I was able to get substantially better results about 2 years ago running SD 2 locally on a gaming laptop. Sure, the images took 30 seconds or so each, but the quality was better than I could get in the demo. Not sure what the point of instantly generating a ton of bad quality images i…

Here's 2.1 demo, released 2 years ago, for comparison: https://huggingface.co/spaces/stabilityai/stable-diffusion

Re: AI model for near-instant image creation on consumer-grade hardware

#26

What does consumer-grade mean in this context - is this referring to an M1 MacBook or a tower full of GPUs? I couldn't find in the paper or README.

One Nvidia A100.

From the paper :

> We train using the AdamW [26] optimizer with a batch size of 5 and gradient accumulation over 20 steps on a single NVIDIA A100 GPU

So it's "consumer-grade" because it's available to anyone, not just businesses.

Re: AI model for near-instant image creation on consumer-grade hardware

#28
post #21

My favorite test of image models: Drawing of the inside of a cylinder. That's usually bad enough. Then try to specify size, and specify things you want to place inside the cylinder relative to the specified size. (e.g. try to approximate an O'Neill cylinder) I love generative AI models, but they're really bad at that, and this one is no exception, but the speed makes playing around with prompt variations to try to se…

Careful how much you say that. I'm sure there's more than a few AI engineers willing to use some 3d graphics program to add a hundred thousand views of the inside of randomly generated shapes to the training set.

Re: AI model for near-instant image creation on consumer-grade hardware

#29

What does consumer-grade mean in this context - is this referring to an M1 MacBook or a tower full of GPUs? I couldn't find in the paper or README.

One Nvidia A100. From the paper : > We train using the AdamW [26] optimizer with a batch size of 5 and gradient accumulation over 20 steps on a single NVIDIA A100 GPU So it's "consumer-grade" because it's available to anyone, not just businesses.

That is the training gpu… the inference gpu can be much smaller.

Re: AI model for near-instant image creation on consumer-grade hardware

#30
post #28
post #21

My favorite test of image models: Drawing of the inside of a cylinder. That's usually bad enough. Then try to specify size, and specify things you want to place inside the cylinder relative to the specified size. (e.g. try to approximate an O'Neill cylinder) I love generative AI models, but they're really bad at that, and this one is no exception, but the speed makes playing around with prompt variations to try to se…

Careful how much you say that. I'm sure there's more than a few AI engineers willing to use some 3d graphics program to add a hundred thousand views of the inside of randomly generated shapes to the training set.

"I will make it legal"
Post reply on HN