Earlier quoted context omitted.
Yep, I see this as a start, and very curious to see the ways in which it’ll get used with a human in the loop, and also the ways human artists will be pushed to creat art that’s out of distribution for these models.
Even then, few artist got famous on technical skill alone, surely less than those who got famous primarily for their message irregardless of their skill. And this is before getting into the endless pit of defining what art is. Besides having an ai doing the legwork is no much different than Veronese giving large swath of paintings to his novices while focusing on the two/three major parts.
How a Stable Diffusion prompt changes its output for the style of 1500 artists
181–190 of 205 posts
Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#182Very cool! I recently made a game kind of like AI "pictionary" where the user has to guess the "artist", subject, and description of a piece of art generated by stable diffusion: https://wcedmisten.fyi/project/paintingGuesser/ I tried to make something more general, but stable diffusion is fairly inconsistent in how well the output matches the semantics of the input.
Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#183Earlier quoted context omitted.
Even then, few artist got famous on technical skill alone, surely less than those who got famous primarily for their message irregardless of their skill. And this is before getting into the endless pit of defining what art is. Besides having an ai doing the legwork is no much different than Veronese giving large swath of paintings to his novices while focusing on the two/three major parts.
I think we agree then - if new technologies allow an artist to more rapidly explore, iterate, and refine a particular message, then those artists should still have something to create beyond what is possible with these images.
Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#184Earlier quoted context omitted.
I don't think the underlying model is word based, but character based. You could download the caption data for LAION and grep that, but it's not strictly 1:1 with what SD was trained against.
No, it's word based. The vocabulary is here: https://huggingface.co/openai/clip-vit-base-patch32/resolve/... It is contextual though, so words in different orders mean different things.
Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#185What frustrates me about Stable Diffusion is there doesn't seem to be any documentation as to what artists or vocabulary it understands. Generally people say "look at existing prompts or use various prompt generators" but that doesn't really solve the problem. I don't want to just look at what other people have randomly discovered; I want to know what the program really knows.
Honest question, would a solid understanding of the open training data help? Having the art vocabulary down as well. In effect, knowing what is present and how it’s tagged so you can « invoke » it more readily in the prompt-result. Maybe I’m out of my depth. I know the corpus of tagged image used for training is enormous … but I still think that would help the user ( a prompt-crafter )
Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#186Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#187Earlier quoted context omitted.
But why isn't the list of words from those captions available anywhere (at least as far as I can tell)? There may be 600 million captions, but the number of unique words would probably be 10 or 20 thousand at most, completely feasible to browse or grep.
Its kind of a weird complaint. If i am having a conversation with someone, i wouldn't be concerned about knowing the set of all possible nouns.
Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#188Earlier quoted context omitted.
It's the nature of ML models--nobody is 100% sure what it understands until they try something and get results. It was given a lot of tagged data: 600 million captioned images from LAION-5B. So if you want to know what it might support, you could try any one of the captions from those 600 million images.
But why isn't the list of words from those captions available anywhere (at least as far as I can tell)? There may be 600 million captions, but the number of unique words would probably be 10 or 20 thousand at most, completely feasible to browse or grep.
Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#189Earlier quoted context omitted.
Whatever else this emergent "creative AI" phenomenon may or may not do, it's definitely touching nerves in people who still believe there's something ineffable and transcendent about the creative experience.
Stable Diffusion is literally copy-pasting existing artwork. It's not creating anything new. If anything, this sort of "AI" only makes human ineffable creative experiences even more valuable, because without it there would be no training set and no "AI".
Do you have a source for that? Somehow I doubt there would be this much interest in a tool that literally just copies existing artwork.
Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists
#190Earlier quoted context omitted.
No, it's word based. The vocabulary is here: https://huggingface.co/openai/clip-vit-base-patch32/resolve/... It is contextual though, so words in different orders mean different things.
Thank you. This is really helpful. Yes, you don't know exactly how SD will respond, but for example you can grep celebrity names and can know whether SD has any chance of drawing a picture with them in it or not rather than just randomly guessing.