Live data from Hacker News

SDXL Turbo: A Real-Time Text-to-Image Generation Model

stability.ai

41–50 of 157 posts

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#41

Works with Automatic111. Generated 20 512x512 on a lowly RTS 2070S with 8GB RAM. Prompt: a man Steps: 1, Sampler: Euler a, CFG scale: 1, Seed: -1, Size: 512x512, Model hash: e869ac7d69, Model: sd_xl_turbo_1.0_fp16, Clip skip: 2, RNG: NV, Version: v1.6.0 Examples: https://imgur.com/a/UuuT9qu

I just want to point out that I’ve noticed sdxl isn’t good at producing images that are 512x512 for some reason. It works much better with at least 768x768 resolution.

Indeed, however one of the listed limitations is: The generated images are of a fixed resolution (512x512 pix), and the model does not achieve perfect photorealism.

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#42

Works with Automatic111. Generated 20 512x512 on a lowly RTS 2070S with 8GB RAM. Prompt: a man Steps: 1, Sampler: Euler a, CFG scale: 1, Seed: -1, Size: 512x512, Model hash: e869ac7d69, Model: sd_xl_turbo_1.0_fp16, Clip skip: 2, RNG: NV, Version: v1.6.0 Examples: https://imgur.com/a/UuuT9qu

I've done a bit of fiddling around with it and definitely holding back judgement for now, seems like the 1 and 2 step images are WAY more coherent than LCM, but the images are kinda trash for any kind of prompt complexity so you start to have to use more steps, and since the individual steps take the same amount of time (I think there's a specific sampler for this which may be faster & better?) by the time you start prompting details you end up using 4 steps and the perf is about the same as LCM, and that breaks down the same way as you start going for more complexity (text, coherent bg details etc) because you end up needing 10-15 steps and at that point you're going to get a much better result from full-fat SDXL x dpmpp3msdee (lol)

Curious to see the bigbrain people tackle this over the next few days and wring all the perf out of it, maybe samplers tailored to this model will give a notable boost.

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#44

Earlier quoted context omitted.

I tested a bit and the quality for photorealistic images is surprisingly bad, and definitely worse than LCM and of course normal SDXL. For more artistic images, SDXL Turbo fares better. Unlike normal SDXL, you're required here to use the old-fashioned syntatic sugar like "8k hd" and "hyperrealistic" to align things.

Are there any good resources for learning a lot of "syntactic sugar" terms? This is new to me, but I'd love to know more.

It is completely dependent on the model. Civit dot ai has model showcases as well as fine-tune showcases, and you can click any image or press the (i) to see the generation info.

Some models like natural language prompts - "draw me a pterodactyl tanning at a beach", some prefer shorthand (danbooru style clip) - "1man, professor, classroom, chalkboard, white_hair, suit", and some work with a mixture of the above as well as the syntactical sugar -"masterpiece, 8k, trending on artstation, space image, a man floating next to a spaceship in space, bokeh, rim lighting, cinematic lighting, Nikon D60, f / 2"

Fine-tuning models - LoRA, etc, allow one to convert prompts from one style to another if they wish, but usually it's to compress an idea, style, person, object, etc in to a single "token", so you can work on other aspects of the image.

Check out civit AI and you can sort of get an idea of the cargo cultism as well as what sort of keywords actually make a difference.

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#45

The license is non-commercial, but: > For clarity, Derivative Works do not include the output of any Model. https://huggingface.co/stabilityai/sdxl-turbo/blob/main/LICE... Doesn't that mean that generated images from it should be fine for commercial?

No, it just means that if they sue you, they're pre-committing to not try and foreclose on your own generated outputs by claiming they're derivatives that they would then own.

Of course, this is a water sandwich. If model outputs are derivatives of the model, it'd be difficult to argue that the model itself isn't a derivative of all the training data, most of which isn't licensed. So if anything, this covers Stability's ass, not yours. There's also the related question of if AI models - not their outputs, just the models themselves - have any copyright at all. The logic behind the non-copyrightability of AI art would also apply to the AI training process, so the only way you could get copyright would be a particularly creative way of organizing and compiling the training dataset.

Remember: while the "AI art isn't art" argument reeks to high heavens of artistic snobbery, it's not entirely wrong. There isn't a lot of creative control in the process. Furthermore, we don't give copyright to monkeys[2], so why should we give it to AI models?

"Noncommercial" isn't actually a thing in copyright law. Copyrighted works are inherently commercial artifacts[0], so if you just say "noncommercial use is fine", you've said nothing - and you've invited the legal equivalent of nasal goblins[1] into the courtroom. Creative Commons gets around this by defining their own concept of NonCommercial use. So what did Stability's lawyers cook up?

> “Non-Commercial Uses” means exercising any of the rights granted herein for the purpose of research or non-commercial purposes. Non-Commercial Uses does not include any production use of the Software Products or any Derivative Works.

Uh... yeah. That's replacing a meaningless phrase with a tautology. Fun. The only concrete grant of rights is research use, and they categorically reject "any production use", which is awfully close to all uses. Even using this to generate funny fanart mashups for your own personal enjoyment could be construed as a 'production use'. Stability could actually sue you for that (however unlikely that would be).

[0] In the eyes of the law. I actually hate this opinion, but it's the opinion the law takes.

[1] Under ISO 9899, it is entirely legal for C programs with undefined behavior to make goblins fly out of your nose.

[2] https://en.wikipedia.org/wiki/Monkey_selfie_copyright_disput...

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#46

Earlier quoted context omitted.

I just want to point out that I’ve noticed sdxl isn’t good at producing images that are 512x512 for some reason. It works much better with at least 768x768 resolution.

Normal SDXL requires 1024x1024 output or the quality degrades significantly.

Hi Max! Thanks for all the tuts! Small correction - SDXL wants ~1 megapixel resolutions at a variety of aspect ratios.

https://github.com/lllyasviel/Fooocus/issues/24

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#47
post #24

Does anyone have any idea of when/if there will be a simple way to get commercial access in one step? Like an API or something? Or if they want to charge for it, then maybe a web check out? It's interesting that they finally decided to try to make something commercially restricted. Do they have a watermark or anything that they can use to track down people who use without a license? Also, is there anything like an op…

Open version predates this one: https://huggingface.co/blog/lcm_lora

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#48
Noncommercial use - aside from being one of my licensing pet peeves - seems to indicate that the money is drying up. My guess is that the investors over at Stability are tired of subsidizing the part of the generative AI market that OpenAI refuses to touch[0].

The thing is, I'm not entirely sure there's a paying portion of the market? Yes, I've heard of people paying for ChatGPT because it answers programming questions really well, but that's individual users, who are cost sensitive. The real money was supposed to be selling these things as worker replacement, but Hollywood unions have (rightfully) shut AI companies out of the markets where a machine that can write endless slop might have made lots of money.

OpenAI can remain in Microsoft's orbit for as long as the stupid altruist / accelerationist doomer debate doesn't tear them apart[1]. Google has at least a few more years of monopoly money before either the US breaks them up or the EU bankrupts them with fees. I don't know who the hell is pumping more money into either Anthropic or Stability.

[0] Porn. It's always porn. OpenAI doesn't want to touch it for very obvious reasons.

[1] For what it's worth, Microsoft has shown that all the AI safety guardrails can be ripped out by the money people at a moment's notice, given how quickly they were able to make the OpenAI board blink.

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#49

Works with Automatic111. Generated 20 512x512 on a lowly RTS 2070S with 8GB RAM. Prompt: a man Steps: 1, Sampler: Euler a, CFG scale: 1, Seed: -1, Size: 512x512, Model hash: e869ac7d69, Model: sd_xl_turbo_1.0_fp16, Clip skip: 2, RNG: NV, Version: v1.6.0 Examples: https://imgur.com/a/UuuT9qu

I've done a bit of fiddling around with it and definitely holding back judgement for now, seems like the 1 and 2 step images are WAY more coherent than LCM, but the images are kinda trash for any kind of prompt complexity so you start to have to use more steps, and since the individual steps take the same amount of time (I think there's a specific sampler for this which may be faster & better?) by the time you start…

Are you finding dpm++ 3M SDE better than dpm++ 2M SDE in sdxl?

Afaik the second order (2M) version is the recommended one to use for guided sampling vs the 3rd order one.

From here: https://huggingface.co/docs/diffusers/v0.23.1/en/api/schedul...

> It is recommended to set solver_order to 2 for guide sampling, and solver_order=3 for unconditional sampling.

Re: SDXL Turbo: A Real-Time Text-to-Image Generation Model

#50
post #24

Does anyone have any idea of when/if there will be a simple way to get commercial access in one step? Like an API or something? Or if they want to charge for it, then maybe a web check out? It's interesting that they finally decided to try to make something commercially restricted. Do they have a watermark or anything that they can use to track down people who use without a license? Also, is there anything like an op…

about my 8th prompt, it told me I had used up my usage and offered an option to sign up for "pro".
Post reply on HN