61–70 of 78 posts
Earlier quoted context omitted.
It is actually based on a different approach, it uses an image-captioning model finetuned on image-prompt pairs
CLIP Interrogator uses BLIP, an image captioning model, as well as trying a bunch of prompts with CLIP. I guess you mean that this model uses the captioning model to generate the complete prompt? Is the code for this one available?
This doesn't work for anything that doesn't use the upstream default stable diffusion checkpoint. I generate a lot of images with Pastel-mix, Anything, Waifu Diffusion and Counterfeit, and none of those are giving sensible results with this tool.
The model underneath this is trained only on data from SD 1.4/5 so this would be expected. I have another model training which covers all models you mentioned which should perform well on those
It's not prompt based intended to generate another one, but rather an accessibility tool.
And some related videos:
Seeing AI 2016 Prototype - A Microsoft research project - https://youtu.be/R2mC-NUAmMk
Seeing AI: Making the visual world more accessible - https://youtu.be/DybczED-GKE
Shameless plug: I have a similar open-source tool which uses locally executed pre-trained models, here https://github.com/kir-gadjello/extract_prompt
Nice, does this use clip-interrogator?
So I tried it with an image of a monkey that I often use for profile pictures ( https://mathstodon.xyz/@OscarCunningham ). This image wasn't made by Stable Diffusion. It gave me this prompt: > a monkey plushie on a white background, photograph taken by steve buscemi from a zoom lens, studio lighting, ultrarealistic Can someone tell me what Steve Buscemi is doing here?
His style is just so beautifully unique
Earlier quoted context omitted.
The model underneath this is trained only on data from SD 1.4/5 so this would be expected. I have another model training which covers all models you mentioned which should perform well on those
Can I have some kind of direct contact with you? Email, Twitter DM, Telegram, heck, I would download some new kind of app just to have some conversations.
Earlier quoted context omitted.
What's interesting to me is that it even tries to predict the prompt on images that came straight from Stable Diffusion with no editing - which is weird because such images actually do have the prompt embedded inside of them already. (At least, that's the case for me - the prompt and parameters are stored in a tEXt chunk in the PNG file, which can be read with, for example, "pngcheck -t".)
This is something specific to the automatic 1111 version. It's just a setting, but I believe it's on by default.