How a Stable Diffusion prompt changes its output for the style of 1500 artists • Hacker News Board

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#41

Post by spijdar » Sun, Oct 02, 2022, 5:43 PM UTC

jhbadger wrote: post #35

pwinnski wrote: post #30

Earlier quoted context omitted.

It's the nature of ML models--nobody is 100% sure what it understands until they try something and get results. It was given a lot of tagged data: 600 million captioned images from LAION-5B. So if you want to know what it might support, you could try any one of the captions from those 600 million images.

But why isn't the list of words from those captions available anywhere (at least as far as I can tell)? There may be 600 million captions, but the number of unique words would probably be 10 or 20 thousand at most, completely feasible to browse or grep.

I don't think the underlying model is word based, but character based. You could download the caption data for LAION and grep that, but it's not strictly 1:1 with what SD was trained against.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#42

Post by thedorkknight » Sun, Oct 02, 2022, 5:45 PM UTC

jhbadger wrote: post #35

pwinnski wrote: post #30

Earlier quoted context omitted.

It's the nature of ML models--nobody is 100% sure what it understands until they try something and get results. It was given a lot of tagged data: 600 million captioned images from LAION-5B. So if you want to know what it might support, you could try any one of the captions from those 600 million images.

But why isn't the list of words from those captions available anywhere (at least as far as I can tell)? There may be 600 million captions, but the number of unique words would probably be 10 or 20 thousand at most, completely feasible to browse or grep.

I haven't downloaded the database myself, but I imagine if you did it wouldn't be too hard to get that data. Looks like you can get the torrent here https://laion.ai/blog/laion-400-open-dataset/

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#43

Post by fassssst » Sun, Oct 02, 2022, 5:46 PM UTC

yieldcrv wrote: post #17

norwalkbear wrote: post #6

Truly impressive, though it gives me some great fear for all the people whose career is art. This will likely take the pareto to a new height instead of 20/80 maybe even 1/99

Their career isn't art anymore. Just in case anyone needed to see this spelled out. The people making fliers have been replaced by AI prompting overnight. The people doing contemporary fine art with their audience are unaffected.

A lot of designers are artists that needed an income. Design jobs will likely be dramatically impacted by this.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#44

Post by MattPalmer1086 » Sun, Oct 02, 2022, 5:46 PM UTC

alexmolas wrote: post #40

Nice experiment! I would only change two things: (1) sort the artists in alphabetical order, and (2) allow users to write the name of the artist and show if it's in the list. I'm saying that because it's a little bit tedious to search for the artist you're looking for. A part from that, I find the idea super-interesting :)

They are in alphabetical order, but by last name. Took me a while to see that though.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#45

Post by sva_ » Sun, Oct 02, 2022, 5:48 PM UTC

The Jackson Pollock one amuses me. He didn't really draw such symbolic pictures afaik, so applying the style makes little sense.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#46

Post by jazzyjackson » Sun, Oct 02, 2022, 5:50 PM UTC

ShamelessC wrote: post #7

pain2022 wrote: post #3

Quoted post unavailable.

> What is this list?! No Picasso, Renoir or Vrubel present Comments like this are why people think HN is nothing but a place to receive a shallow dismissal of your efforts. It's a list. Make your own.

> Comments like this are why people think HN is nothing but a place to receive a shallow dismissal of your efforts.

whatever

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#47

Post by sva_ » Sun, Oct 02, 2022, 5:51 PM UTC

alexmolas wrote: post #40

Nice experiment! I would only change two things: (1) sort the artists in alphabetical order, and (2) allow users to write the name of the artist and show if it's in the list. I'm saying that because it's a little bit tedious to search for the artist you're looking for. A part from that, I find the idea super-interesting :)

You can also just focus the select element and enter the full name to make it jump to the right name. But a real input would be better.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#48

Post by [deleted] » Sun, Oct 02, 2022, 5:51 PM UTC

pessimizer wrote: post #29

krisoft wrote: post #26

Earlier quoted context omitted.

> The people making fliers have been replaced by AI prompting overnight. Hmm, no? Do go and try to make a flyer with any of the AI generators. I’m not saying it can’t happen one day, but the current tech is not there.

Flyers are an extremely low bar that AI sails over.

[deleted]

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#49

Post by logisticpeach » Sun, Oct 02, 2022, 5:52 PM UTC

Hate to say it but when i see stuff like this it only reminds me of what we could have achieved if this ingenuity had been applied in another domain.

Can't help feeling that this accidentally harms creative types and risks swamping us with visual junk.

The technical achievment is astounding but no-one would seriously claim that crafting an image via a short prompt is creative except in the most cursory way.

I'm probably missing some life changing use-case, but apeing art in random styles can't be it.

Re: How a Stable Diffusion prompt changes its output for the style of 1500 artists

#50

Post by seanwilson » Sun, Oct 02, 2022, 5:53 PM UTC

yieldcrv wrote: post #17

norwalkbear wrote: post #6

Truly impressive, though it gives me some great fear for all the people whose career is art. This will likely take the pareto to a new height instead of 20/80 maybe even 1/99

Their career isn't art anymore. Just in case anyone needed to see this spelled out. The people making fliers have been replaced by AI prompting overnight. The people doing contemporary fine art with their audience are unaffected.

> The people making fliers have been replaced by AI prompting overnight.

I haven't seen good examples of that yet but I'm curious how push-button you can make this. Flyers, web design and UI design require the copy, layout, information hierarchy, colours, illustrations, branding etc. to be cohesive so it's a different problem space with way more constraints compared to generating a single image.

If getting the final design requires a lot of rounds of prompting and tweaks, busy people are going to outsource this still (in the hope the prompting and feedback needed to the person doing the work will be less).