AI model for near-instant image creation on consumer-grade hardware

#1

Post by giuliomagnifico » Tue, Dec 10, 2024, 4:44 PM UTC

AI model for near-instant image creation on consumer-grade hardware
surrey.ac.uk

Re: AI model for near-instant image creation on consumer-grade hardware

#2

Post by Sharlin » Tue, Dec 10, 2024, 5:32 PM UTC

For those wondering, it's an adversarially distilled SDXL finetune, not a new base model.

Re: AI model for near-instant image creation on consumer-grade hardware

#3

Post by quikoa » Tue, Dec 10, 2024, 6:43 PM UTC

Github: https://chendaryen.github.io/NitroFusion.github.io/

Paper: https://arxiv.org/html/2412.02030v2

Re: AI model for near-instant image creation on consumer-grade hardware

#4

Post by betenoire » Tue, Dec 10, 2024, 6:59 PM UTC

Here is the demo https://huggingface.co/spaces/ChenDY/NitroFusion_1step_T2I

I'm unable to get anything that looks as good as the images in the README, what's the trick for good image prompts?

Re: AI model for near-instant image creation on consumer-grade hardware

#5

Post by speerer » Tue, Dec 10, 2024, 7:24 PM UTC

betenoire wrote: post #4

Here is the demo https://huggingface.co/spaces/ChenDY/NitroFusion_1step_T2I I'm unable to get anything that looks as good as the images in the README, what's the trick for good image prompts?

I always just assume it's the magic of selection bias.

Re: AI model for near-instant image creation on consumer-grade hardware

#6

Post by avereveard » Tue, Dec 10, 2024, 7:47 PM UTC

betenoire wrote: post #4

Here is the demo https://huggingface.co/spaces/ChenDY/NitroFusion_1step_T2I I'm unable to get anything that looks as good as the images in the README, what's the trick for good image prompts?

I get pretty close result with seed 0

paper https://i.imgur.com/l90WYrT.png

replication on hf https://i.imgur.com/MqN1Qwc.png

Re: AI model for near-instant image creation on consumer-grade hardware

#7

Post by nprateem » Tue, Dec 10, 2024, 7:49 PM UTC

The devil's in the details as always. A "cartoon of a cat eating an icecream on a unicycle" doesn't bring back any of the 6-pawed mutant cats riding a unicycle, etc. Still, impressive speed.

Re: AI model for near-instant image creation on consumer-grade hardware

#8

Post by betenoire » Tue, Dec 10, 2024, 7:52 PM UTC

avereveard wrote: post #6

betenoire wrote: post #4

Here is the demo https://huggingface.co/spaces/ChenDY/NitroFusion_1step_T2I I'm unable to get anything that looks as good as the images in the README, what's the trick for good image prompts?

I get pretty close result with seed 0 paper https://i.imgur.com/l90WYrT.png replication on hf https://i.imgur.com/MqN1Qwc.png

the imgur link is bad, but I hadn't noticed the prompt tucked away in those reference images and that helps. Thanks

(I had asked for a rock climber dangling from a rope, eating a banana, and they were wildly nonsensical images)

Re: AI model for near-instant image creation on consumer-grade hardware

#9

Post by deckar01 » Tue, Dec 10, 2024, 7:59 PM UTC

betenoire wrote: post #4

Here is the demo https://huggingface.co/spaces/ChenDY/NitroFusion_1step_T2I I'm unable to get anything that looks as good as the images in the README, what's the trick for good image prompts?

I had the same issue, so I pulled in the SDXL refiner. Night and day better even at one step.

https://gist.github.com/deckar01/7a8bbda3554d5e7dd6b31618536...

Re: AI model for near-instant image creation on consumer-grade hardware

#10

Post by iLoveOncall » Tue, Dec 10, 2024, 8:05 PM UTC

> Instant image generation that responds as users type – a first in the field

Stable Diffusion Turbo has been able to do this for more than a year, even on my "mere" RTX 3080.