Live data from Hacker News

Img2Prompt – Get prompts from stable diffusion generated images

img2prompt.io

41–50 of 78 posts

Re: Img2Prompt – Get prompts from stable diffusion generated images

#43
post #41

This doesn't work for anything that doesn't use the upstream default stable diffusion checkpoint. I generate a lot of images with Pastel-mix, Anything, Waifu Diffusion and Counterfeit, and none of those are giving sensible results with this tool.

The model underneath this is trained only on data from SD 1.4/5 so this would be expected. I have another model training which covers all models you mentioned which should perform well on those

Re: Img2Prompt – Get prompts from stable diffusion generated images

#45
post #41

This doesn't work for anything that doesn't use the upstream default stable diffusion checkpoint. I generate a lot of images with Pastel-mix, Anything, Waifu Diffusion and Counterfeit, and none of those are giving sensible results with this tool.

The model underneath this is trained only on data from SD 1.4/5 so this would be expected. I have another model training which covers all models you mentioned which should perform well on those

I'd be interested to see the results of that. My email address is on my Hacker News profile if you want to talk there.

Re: Img2Prompt – Get prompts from stable diffusion generated images

#46
post #39

Yeah I wouldn't say it's very close: Tried it on last image I generated on: https://blazordiffusion.com/artifacts/50/50418_studio-ghibli... Original Prompt: > Studio ghibli, rocket explosion, jungle, solar, green technology, optimist future > 8k, Bokeh effect, Cinematic Lighting, Octane Render, Iridescence, Vibrant > by Beeple, Asher Brown Durand, Dan Mumford, Greg Rutkowski, WLOP Img2Prompt: > a vehicle in the grass…

Agreed, results not good for this style of images. I have a model training on a much bigger dataset of image-prompt pairs which should perform better on this.

Re: Img2Prompt – Get prompts from stable diffusion generated images

#47

Hugged to death already? I often use terms like "sexy", "risque" etc. in the process of getting images that are quite sensible (like military people playing chess). I use img2img repeatedly looking for particular photo-film aesthetics and tend to accumulate prompts. Anyway, this would open me to charges of sexism (or worse "misogyny"), and makes me uneasy about using SD. Edit/OH: it generates prompts for like Excel s…

Why does it choke on img2img creations? This is just fascinating. It gives a plausible prompt to at least a handful of real non-AI photos from DSLRs and iphones alike.

The dataset used to train this model didn’t have any img2img data so that would explain it

Re: Img2Prompt – Get prompts from stable diffusion generated images

#48

Earlier quoted context omitted.

Why does it choke on img2img creations? This is just fascinating. It gives a plausible prompt to at least a handful of real non-AI photos from DSLRs and iphones alike.

The dataset used to train this model didn’t have any img2img data so that would explain it

I mean, it does mistake Frank Sinatra for Louis Armstrong -- I guess it makes errors. But it just refuses to process my img2img images. It breaks down. Why?

It made me so agitated I made a gallery[0]. Granted, some of those images are strange, but others are just normal people doing normal things.

[0]: https://publish.obsidian.md/zero-chroma-infinity/Image+galle...

Re: Img2Prompt – Get prompts from stable diffusion generated images

#49
So, people are commenting that it's not very accurate etc., but I love it. Delightfully quirky tool for exploring prompts.

Also I laughed out loud after putting a selfie into it and getting "mark zuckerberg's face reflected in a mirror, close up, realistic photo, medium shot, dslr, 4k, detailed"

Re: Img2Prompt – Get prompts from stable diffusion generated images

#50

So I tried it with an image of a monkey that I often use for profile pictures ( https://mathstodon.xyz/@OscarCunningham ). This image wasn't made by Stable Diffusion. It gave me this prompt: > a monkey plushie on a white background, photograph taken by steve buscemi from a zoom lens, studio lighting, ultrarealistic Can someone tell me what Steve Buscemi is doing here?

His style is just so beautifully unique
Post reply on HN