Live data from Hacker News

The AI Unbundling

stratechery.com

191–200 of 207 posts

Re: The AI Unbundling

#191
post #67

Earlier quoted context omitted.

> If there was a Borgesian book containing, say, all possible 512x512 images, one on each page, then surely two people having the same copy of that book wouldn't need to exchange images, they could simply exchange page numbers, and see exactly what the other one is referring to. If that were the case, the page number would be as long as the image, and exchanging one or the other is the same. Heck with proper order ar…

What could contain information is a book of all 512x512 images that a human being would perceive as being "an image". Ie, the vast majority of possible 512x512 images look like random noise to humans. Excluding those massively shrinks the size of the book. So that does mean image model AI like dall-e/SD are effectively compression over this space of images that they can generate (which is at least attempting to emula…

Ah yes, conceptually, SD is a filter that removes noise (~ things that look like noise to us) from the space of all possible pixel combinations. It's interesting that it's also how it works in practice.

Re: The AI Unbundling

#192

Earlier quoted context omitted.

Except it is actually if you've been following the workflows which have popped up since stable diffusion's release. These models are not limited to just making a image which vaguely matches some description. They can also inpaint specific portions of an image, turn a vague sketch into a finished looking image, and blend together different images in convincing ways. A workflow for creating a high quality looking piece…

I haven't heard of anything like this but I haven't following closely. I also have questions, what is the "Generate detailed scene based on that sketch" process? Can an algorithm do this? Can a person easily do this? I'd be more impressed than with the raw pictures. Similarly with your #3.

The Image2Image part of StableDiffusion lets you do that. For example https://old.reddit.com/r/restofthefuckingowl/comments/x4w3mn...

Re: The AI Unbundling

#193
post #47

Earlier quoted context omitted.

Some art, technical and scientific illustration in particular, requires a great deal of precision, and ability to interpret information. That work isn't going away any time soon, and is similar to what is required of professional translation. A lot of art does not require that.

Are you under the impression that right now, as of today, the publicly-available AI models are ready to replace humans for all types of art outside of scientific and technical illustration? Because that's not true at all. The AI can't even draw hands yet. To say nothing of its ability to handle multiple people and objects interacting in complex scenes. I'm concerned that the discussions about AI art on forums like HN…

> they don't actually have a serious and nuanced appreciation of art and they don't have a good understanding of all the types of work that artists do.

I would extend this lack of nuance and understanding to the deep learning implementation side also. A lot of people seem to have some very foundational misconceptions about what deep learning is and what it does. In the case of generative art: these models are “simply” sampling from the frozen statistical structure they have learned from web images and their captions. They don’t understand the relationship between objects in space, they have no ideas or feelings to express, and they communicate nothing. That’s why the even the best output of these models tends to have a perceptible hollowness: you can detect the lack of a coherent authorial intent in it.

Re: The AI Unbundling

#194

Earlier quoted context omitted.

This nitpick about hands sounds desperate. Here we are, with a tech so powerful that it overshadows the default hype it's surrounded by (no small feat, most technologies fail to live up to the hype as you know) ... and the critics merely move the goalpost a tiny bit further, even if the tech scales so well as to make their new goalpost irrelevant in a year.

It's not a nitpick. It might be a nitpick if hands were the only thing it couldn't do. But it struggles with a lot more than just hands. >the tech scales so well as to make their new goalpost irrelevant in a year. This just brings me back to my original question. Self-driving cars have been "a year away" for many years now, and now companies are starting to hint that human assistance may be required for the foreseeab…

I have a suspicion that generative art is going to hit a data wall, also. All of these models are constrained in what patterns they can learn because image captions are not very precise. They can rehash common motifs associated with keywords, but they’re not good at following specific instructions. (“The chair is at the corner of the rug, turned 15 degrees to the left, with the leg nearest the camera aligned with the edge of the fireplace.”) For them to meaningfully improve in this regard, I have to imagine someone will need to locate a trove of a few billion images with exceptionally high quality captions, and well distributed throughout the space of possible image types, subjects, themes, and styles.

Re: The AI Unbundling

#195

Earlier quoted context omitted.

It's not a nitpick. It might be a nitpick if hands were the only thing it couldn't do. But it struggles with a lot more than just hands. >the tech scales so well as to make their new goalpost irrelevant in a year. This just brings me back to my original question. Self-driving cars have been "a year away" for many years now, and now companies are starting to hint that human assistance may be required for the foreseeab…

I have a suspicion that generative art is going to hit a data wall, also. All of these models are constrained in what patterns they can learn because image captions are not very precise. They can rehash common motifs associated with keywords, but they’re not good at following specific instructions. (“The chair is at the corner of the rug, turned 15 degrees to the left, with the leg nearest the camera aligned with the…

I think that details like angle and position will be resolved by using basic sketches as a starting point (we can already make images that sort of conform to layouts as well as prompts), and subdividing the image into assets it then has to stitch together in subsequent steps, and then adjusting lighting/contrast/style as a set of filters in post processing. The wall is lowered quite a bit when you don't insist on doing everything from a single magic prompt

(This will be great from the point of view of art creation; not so great from the point of view of supposedly rendering humans obsolete)

Re: The AI Unbundling

#196

Earlier quoted context omitted.

Sure, but eventually we’re going to hit on environmental and cost-effective power limits of training, and it’s not worth the cost to train the model. AFAIUI, that’s part of the point that Gebru was trying to make before she was fired.

This makes me wonder what the costs of training an actual human artist are. Are AIs less efficient?

You can create a lot more copies of the AI.

But then again, when it comes to commercial needs, a human doesn't need "retraining" every time you ask them to draw something they weren't familiar with when they went through art school...

Re: The AI Unbundling

#197

Earlier quoted context omitted.

I have a suspicion that generative art is going to hit a data wall, also. All of these models are constrained in what patterns they can learn because image captions are not very precise. They can rehash common motifs associated with keywords, but they’re not good at following specific instructions. (“The chair is at the corner of the rug, turned 15 degrees to the left, with the leg nearest the camera aligned with the…

I think that details like angle and position will be resolved by using basic sketches as a starting point (we can already make images that sort of conform to layouts as well as prompts), and subdividing the image into assets it then has to stitch together in subsequent steps, and then adjusting lighting/contrast/style as a set of filters in post processing. The wall is lowered quite a bit when you don't insist on doi…

That makes sense. I don’t think that will render humans obsolete; I think it will just increase their productivity and ultimately raise the standard of quality expected. It means artists can explore and iterate on ideas faster than if they had to lay down preliminary artifacts manually. But it doesn’t eliminate the need for authorship: someone still needs to decide what to communicate visually and how to communicate it.

Re: The AI Unbundling

#198

Earlier quoted context omitted.

> In the modern art interpretation artists will not lose to SD. SD will enable them to do different things. Indeed. There was a time in the past ages in which one had to wait for a certain dye to arrive in your local merchant, take it and mix it with another dye in order to be able to paint a color that you need painted in your painting. They also waited and scoured for brushes and other supplies. Those tools and sup…

> The artists now will be able to say "Put a distant view of Shangri-La, half visible behind a misty mountain during sunset, as the traveler gazes at it and wonders when he will finally arrive there". And they will have it. Not so fast. To me this is the part that people are glossing over a bit too quickly in those discussions. How does the person making this know it's actually good art? How do they pick between the…

> How does the person making this know it's actually good art?

How did Van Gogh know he was making good art when he cut off his ear...

> Wouldn't they have to be familiar with principles of composition, color, dynamics, and so on?

It really doesn't feel like art is something that can be formulated and constrained as such. And it never was. All of those are techniques to effect certain results to convey the emotion or the idea. If the computer already does the technique part, what's left to the artist is to imagine, feel and express.

> As it becomes easier to generate the art, it becomes more important to be capable of differentiating it (except for purely "industrial" production where "good enough" will do).

And you can be sure that people will differentiate themselves. Like how they did in every age before. Moreover, those who had a talent for art, but not a talent for all the techniques and the tricks that goes into making that art happen, will now start making art.

> What's the AI worth if it's supposed to generate Shakespeare-level writing, but no one is capable of assessing its quality?

If an AI is generating Shakespeare-level writing, and no one is capable of assessing its quality, then that's Shakespeare-level writing and its good.

Let's face it: Most of the 'high quality' criteria comes from our beautification and exaggeration of the arts of the past. There isn't any objective formula that is used to assess the 'quality' of any art.

If art creates thoughts and emotions in you, its good art.

Re: The AI Unbundling

#199

Earlier quoted context omitted.

> The artists now will be able to say "Put a distant view of Shangri-La, half visible behind a misty mountain during sunset, as the traveler gazes at it and wonders when he will finally arrive there". And they will have it. Not so fast. To me this is the part that people are glossing over a bit too quickly in those discussions. How does the person making this know it's actually good art? How do they pick between the…

> How does the person making this know it's actually good art? How did Van Gogh know he was making good art when he cut off his ear... > Wouldn't they have to be familiar with principles of composition, color, dynamics, and so on? It really doesn't feel like art is something that can be formulated and constrained as such. And it never was. All of those are techniques to effect certain results to convey the emotion or…

> How did Van Gogh know he was making good art when he cut off his ear...

I wouldn't know, but I'm not sure what that point illustrates?

I'm fairly sure Van Gogh had a pretty good idea how his art was different/stood out from what existed, and could articulate why he did it a certain why (i.e. why it was good, to him at least). I'm far less certain about some random person with no art background typing a prompt being capable of the same analysis/understanding (that's also why 99% of AI art so far is transparently derivative).

To be clear — my point isn't that AI-art is bad or whatever. It's that it could displace/change the nature of what making art is about, and that incidentally it might require new skills or more extreme versions of existing skills, making the fear of the disappearance of "artists" overblown (and as a corollary making the idea that anyone can become capable of creating meaningful art exaggerated as well).

> It really doesn't feel like art is something that can be formulated and constrained as such. And it never was. All of those are techniques to effect certain results to convey the emotion or the idea. If the computer already does the technique part, what's left to the artist is to imagine, feel and express.

Right, but "expression" isn't something trivial, that's the point. If the prompt is "Harbor scene", there's a billion ways to realize that. Someone would presumably have to have the vocabulary/knowledge to navigate that space and produce something worthwhile in the end.

There's probably something to be said about the amount of control the artist gets on the output as well. The more we try to reintroduce post-hoc adjustments to e.g. an AI-generated image, the more we make "new art" look like "old art" (i.e. requires significant specific technical knowledge, albeit with different tools that paint and brushes).

Maybe it hits a balance, maybe it just goes back to the same situation as before.

> And you can be sure that people will differentiate themselves. Like how they did in every age before. Moreover, those who had a talent for art, but not a talent for all the techniques and the tricks that goes into making that art happen, will now start making art.

Yup, that's another important point. AI just becomes the new normal. But it will take skills to stand out given that new tool set. AI generated "art" will be seen the same way we see children doodles.

> If an AI is generating Shakespeare-level writing, and no one is capable of assessing its quality, then that's Shakespeare-level writing and its good.

Eh, disagree. If people had no knowledge of what poetry existed in the past or no understanding of it (think average college freshman essay), it certainly wouldn't follow that AI-generated crappy nursery rhymes would become Shakespeare-level poetry.

> Let's face it: Most of the 'high quality' criteria comes from our beautification and exaggeration of the arts of the past. There isn't any objective formula that is used to assess the 'quality' of any art.

That's why I made the point about curation.

If there's no "objective" quality to art, it's entirely narrative-based, whether on a past canon, or some sort of manifesto/principles something should stick to (think of modern art movements).

The job becomes completely different — it's not about the technical details of the work itself, but about how it's inserted in a larger cultural phenomenon ascribing certain values to art itself or certain principles in particular.

> If art creates thoughts and emotions in you, its good art.

To the person creating it, maybe, but then we're definitely talking about something different than ("high") art the way it's been talked about in academic discourse for the past ~2500 y. There has so be at least a common perception about the value of a piece of art for it to be considered as such.

Re: The AI Unbundling

#200

Earlier quoted context omitted.

You don't get it. > A never-ending stream of novel music that tailors itself to you. That's worthless. A firehose of novelty is almost immediately no longer novel. Why would anyone want this? It's the same problem already with streaming services and their own series. They're all already joyless and immediately forgettable. They have less and less value. Your breathlessly described "amazing transformation" sounds incr…

> You don't get it. It's easy to say that as someone on the outside without skin in the game, not working on this, not in the know. > That's worthless. A firehose of novelty is almost immediately no longer novel. And yet here you are on HN. I'll bet you have a Twitter and phone and consume social media, too. That's all just a poor man's version of what we'll be building. > Why would anyone want this? I have literally…

> And yet here you are on HN. I'll bet you have a Twitter and phone and consume social media, too. That's all just a poor man's version of what we'll be building.

A better version of a net negative is still negative.

Maybe I'm wrong, but it really sounds like more of what we've already proven isn't good.

> It's easy to say that as someone on the outside without skin in the game, not working on this, not in the know.

But you sound like you're in a cult.

Post reply on HN