Live data from Hacker News

How a Stable Diffusion prompt changes its output for the style of 1500 artists

gorgeous.adityashankar.xyz

31–40 of 205 posts

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#31

Truly impressive, though it gives me some great fear for all the people whose career is art. This will likely take the pareto to a new height instead of 20/80 maybe even 1/99

Their career isn't art anymore. Just in case anyone needed to see this spelled out. The people making fliers have been replaced by AI prompting overnight. The people doing contemporary fine art with their audience are unaffected.

[deleted]

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#32

Truly impressive, though it gives me some great fear for all the people whose career is art. This will likely take the pareto to a new height instead of 20/80 maybe even 1/99

Art is rarely about the product. Some color on a canvas has been traded for millions, while anyone could just have dropped a bucket of paint to create a similar result.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#33

What frustrates me about Stable Diffusion is there doesn't seem to be any documentation as to what artists or vocabulary it understands. Generally people say "look at existing prompts or use various prompt generators" but that doesn't really solve the problem. I don't want to just look at what other people have randomly discovered; I want to know what the program really knows.

The simple answer is that there is no clean cut list of artists that it "understands". The model has no explicitly programmed concept of artist or style -- just the CLIP based text encoding used to train the conditional autoencoding part of the denoiser network, trained on (AFAIK) caption data recorded with the image.

So in practice asking for art "in the style of " is sort of limiting the denoiser to statistical pathways resembling other images captioned "in the style of ". At least, that's my understanding. Still trying to grok ML and diffusion models.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#34

Truly impressive, though it gives me some great fear for all the people whose career is art. This will likely take the pareto to a new height instead of 20/80 maybe even 1/99

Their career isn't art anymore. Just in case anyone needed to see this spelled out. The people making fliers have been replaced by AI prompting overnight. The people doing contemporary fine art with their audience are unaffected.

this seems exactly backwards

SD isn't outputting clean graphic designs with sensible content

And haven't there already been people winning contemporary fine art contests with SD? lol

https://www.reddit.com/r/StableDiffusion/comments/x2n0r1/aig...

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#35

What frustrates me about Stable Diffusion is there doesn't seem to be any documentation as to what artists or vocabulary it understands. Generally people say "look at existing prompts or use various prompt generators" but that doesn't really solve the problem. I don't want to just look at what other people have randomly discovered; I want to know what the program really knows.

It's the nature of ML models--nobody is 100% sure what it understands until they try something and get results. It was given a lot of tagged data: 600 million captioned images from LAION-5B. So if you want to know what it might support, you could try any one of the captions from those 600 million images.

But why isn't the list of words from those captions available anywhere (at least as far as I can tell)? There may be 600 million captions, but the number of unique words would probably be 10 or 20 thousand at most, completely feasible to browse or grep.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#36
post #26

Earlier quoted context omitted.

> The people making fliers have been replaced by AI prompting overnight. Hmm, no? Do go and try to make a flyer with any of the AI generators. I’m not saying it can’t happen one day, but the current tech is not there.

Flyers are an extremely low bar that AI sails over.

show an example?

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#37

What frustrates me about Stable Diffusion is there doesn't seem to be any documentation as to what artists or vocabulary it understands. Generally people say "look at existing prompts or use various prompt generators" but that doesn't really solve the problem. I don't want to just look at what other people have randomly discovered; I want to know what the program really knows.

You can't really debug an AI. The dimensions of it's understanding are quite literally beyond human interpretation, which makes it both smarter/more efficient than humans while also extremely dumb and context-unaware. Most of our attempts at adding a 'memory' to AI has been a hack thus far, which is why all of these prompts consist of people force-feeding word salad down the AI's throat for generally reproducible results.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#39
post #26

Earlier quoted context omitted.

Their career isn't art anymore. Just in case anyone needed to see this spelled out. The people making fliers have been replaced by AI prompting overnight. The people doing contemporary fine art with their audience are unaffected.

> The people making fliers have been replaced by AI prompting overnight. Hmm, no? Do go and try to make a flyer with any of the AI generators. I’m not saying it can’t happen one day, but the current tech is not there.

Its a post about how artists monetize.

That group will never be selling their own work as contemporary fine art but want that prestige, and the one way they had to make table scraps with that skillset is now gone.

A different person is doing their own flyer art with AI and adding words around it themselves, as evidence by my last months worth of fliers that have reached me. Promotion companies have always been up on trendy tools for differentiation.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#40
Nice experiment! I would only change two things: (1) sort the artists in alphabetical order, and (2) allow users to write the name of the artist and show if it's in the list.

I'm saying that because it's a little bit tedious to search for the artist you're looking for.

A part from that, I find the idea super-interesting :)

Post reply on HN