Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Img2Prompt – Get prompts from stable diffusion generated images

img2prompt.io

Post reply on HN
Print view View original

11–20 of 78 posts

Re: Img2Prompt – Get prompts from stable diffusion generated images

#11

Post by klondike_klive »

OscarCunningham wrote: post #3

So I tried it with an image of a monkey that I often use for profile pictures ( https://mathstodon.xyz/@OscarCunningham ). This image wasn't made by Stable Diffusion. It gave me this prompt: > a monkey plushie on a white background, photograph taken by steve buscemi from a zoom lens, studio lighting, ultrarealistic Can someone tell me what Steve Buscemi is doing here?

This is the thing about AI that I find simultaneously wonderful and terrifying. Something to do with me as a human, noticing a hilarious detail amidst a fathomless ocean. It affirms my humanity but the backdrop is dizzying randomness.

Re: Img2Prompt – Get prompts from stable diffusion generated images

#13

Post by speedgoose »

Isn’t it just CLIP ? The model that made these image generation models possible.

It’s good to describe a picture but it’s not reverse engineering. The predicted prompt usually has very little in common with the actual prompt. And it’s worse when you use embeddings or fine tuned models.

Re: Img2Prompt – Get prompts from stable diffusion generated images

#14

Post by yreg »

speedgoose wrote: post #13

Isn’t it just CLIP ? The model that made these image generation models possible. It’s good to describe a picture but it’s not reverse engineering. The predicted prompt usually has very little in common with the actual prompt. And it’s worse when you use embeddings or fine tuned models.

I'm surprised that the results seem much better (more detailed and sometimes closer to the original prompt) than the regular CLIP interrogation (at least based on my limited experimentation).

But as you say, even so, it still has little in common with the original prompt.

Re: Img2Prompt – Get prompts from stable diffusion generated images

#16

Post by Sophira »

speedgoose wrote: post #13

Isn’t it just CLIP ? The model that made these image generation models possible. It’s good to describe a picture but it’s not reverse engineering. The predicted prompt usually has very little in common with the actual prompt. And it’s worse when you use embeddings or fine tuned models.

What's interesting to me is that it even tries to predict the prompt on images that came straight from Stable Diffusion with no editing - which is weird because such images actually do have the prompt embedded inside of them already. (At least, that's the case for me - the prompt and parameters are stored in a tEXt chunk in the PNG file, which can be read with, for example, "pngcheck -t".)

Re: Img2Prompt – Get prompts from stable diffusion generated images

#20

Post by the_generalist »

OscarCunningham wrote: post #3

So I tried it with an image of a monkey that I often use for profile pictures ( https://mathstodon.xyz/@OscarCunningham ). This image wasn't made by Stable Diffusion. It gave me this prompt: > a monkey plushie on a white background, photograph taken by steve buscemi from a zoom lens, studio lighting, ultrarealistic Can someone tell me what Steve Buscemi is doing here?

How do you do fellow humans?
Post reply on HN