Live data from Hacker News

The 100k whys of AI

lcamtuf.substack.com

81–90 of 111 posts

Re: The 100k whys of AI

#81
post #28

Earlier quoted context omitted.

Also since those are lazy, you are also asking always in the same manner. How homogeneous were the prompts that generated those covers? People are making cookies with cookie cutter number 5 and other people wonder how come they are all the same.

Classic self selection effect though - if you’re resorting to LLM writing you’re almost certainly skewing lazy enough to not even bother trying to add perturbations strong enough to make the response deviate from the uniformity of the slop.

I do think that's a big part of it. AI output moves towards the average, and anyone who wants to use it doesn't care enough to push against that tendency.

Re: The 100k whys of AI

#82
post #28

Earlier quoted context omitted.

Classic self selection effect though - if you’re resorting to LLM writing you’re almost certainly skewing lazy enough to not even bother trying to add perturbations strong enough to make the response deviate from the uniformity of the slop.

I do think that's a big part of it. AI output moves towards the average, and anyone who wants to use it doesn't care enough to push against that tendency.

Seems that both you and the gp are starting from the assumption that those uniform results are representative of those who use AI and of AI usage. In fact they have been chosen for their uniformity- they might be only a small part of a much more varied output obtained by more demanding (or lucky) users.

Re: The 100k whys of AI

#83
post #22
post #17

Earlier quoted context omitted.

I suspect there are new invariants emerging. We don’t know what they are and we will probably have to reach into the liberal arts to describe them but to me what you’re seeing is akin to the subatomic world exposing itself through diffraction patterns.

You're just looking for the study of rhetoric. LLMs have clustered on certain rhetorical patterns/gestures, probably because of a combination of frequency in input and bias in training. But rhetoric also concerns the logical structures that underpin communicative techniques, and it's this logical infrastructure that's shaky or bizarre in LLM content (like the GP noticing how "pushback" always resolves without further…

Discussing style is only scratching the surface on classical rhetoric.

An LLM will rarely be able to move the needle on ethos or pathos beyond generating well-formed sentences with proper spelling.

Re: The 100k whys of AI

#84
post #3

When you generate one or two blog posts with LLM they look pretty good. And you will be impressed with that one clever bit it adds that you didn't even ask for. But then you generate 50 of them and they all converge into the same pattern. It's hard to prove that an article is AI generated but they are instantly recognizable. An aside, I usually take my written blog posts through a pass on Notebooklm to generate a pod…

> But then you generate 50 of them and they all converge into the same pattern.

The AI slop that appears on YouTube as "revenge stories" and "POV life" all have that pattern. There's almost always a Marcus and a Richard, sometimes a Victoria, and they have consistent personalities across stories.

Re: The 100k whys of AI

#85
post #2

A nice illustration of the homogeneity of LLM responses. Another way to describe this effect would be… If you ask humans to write 1,000 books, you're asking 1,000 different humans with different experiences and different skills and different moods (etc.) to write those books. But if you ask LLMs to write 1,000 books, you're probably only talking to 3 or 5 different models, tops. And they've all trained on the same or…

LLMs are great at producing average. We see this with their GenAI music equivalents. All the music these GenAI models produce is exceptionally (aggressively, even) average. It is the most polished average you'll ever find. Never awful (anymore), never fantastic. Just bang in the middle.

>Never awful (anymore), never fantastic

Don't know about that, I always found average awful in itself, even in human output (like most pop), and even more so in AI output.

Something actually awful can be better than average - more entertaining and more felt. I'd rather watch The Room than an average movie.

Re: The 100k whys of AI

#86

Earlier quoted context omitted.

I do think that's a big part of it. AI output moves towards the average, and anyone who wants to use it doesn't care enough to push against that tendency.

Seems that both you and the gp are starting from the assumption that those uniform results are representative of those who use AI and of AI usage. In fact they have been chosen for their uniformity- they might be only a small part of a much more varied output obtained by more demanding (or lucky) users.

I think the uniformity is real. All users interact with the same initial state of the model when they start each chat. Models are not trained to be wildly creative and try to stick to the point. So when users prompt them in pretty much the same manner they quite stably generate very similar output.

I wonder if there aren't a simple creative hack to discover, for example to prompt the model to produce more unexpected output just by injecting some randomness before the actual creative command in the prompt.

Re: The 100k whys of AI

#87

Earlier quoted context omitted.

That whole thing would get you 1000 variants of existing art. But if you asked a thousand different designers to do a cover for the same book...

> 1000 variants of existing art. This is very naive. I can almost guarantee that some combinations of 20 * 50 features will hit on something that has never been written before in that specific combination . And if that's still not enough, increase the number of features. Add more randomness, add more steering, add random steering in random chapters, change it up, and so on.

>will hit on something that has never been written before in that specific combination

That's a very low bar. The skill of an artist is not in writing something that "has never been written before in that specific combination", it's in writing something that's unique or better that what was there, even if it has been written before in that specific combination.

Re: The 100k whys of AI

#88
post #75

Earlier quoted context omitted.

Yes but not very different results (unless you're adding new information to your prompt or reducing some ambiguity). Prompt engineering is mostly pseudoscience.

> Prompt engineering is mostly pseudoscience. Not my experience.

Do you have anything others can reliably reproduce? If not… well it wasn't science.

Re: The 100k whys of AI

#89
Aw, it's just one big picture of book covers. You can't click on the books and read them. If they're AI-written, they're not copyrightable, so you could post the full text. Looking at the books side by side would be interesting.

A test for AI-generated art: railroad tracks. For some reason, none of the image generators can get railroad trackage even close to correct. Just getting long, parallel rails correct seems to be hard. Where there are multiple tracks, trains are positioned between tracks. Rail spacing, tie spacing, and clearances are all wrong. Two long parallel tracks without the rails getting mixed up is rare. Curves are wrong. Switches are hopeless.

There may be something about maintaining strong coherence all the way across an image that's hard for Stable Diffusion type systems. Iterated local refinement seems to botch this class of image.

Examples: [1][2][3][4][5][6]

[1] https://www.vecteezy.com/photo/37205933-ai-generated-high-sp...

[2] https://www.dreamstime.com/royalty-free-stock-photography-mo...

[3] https://www.magnific.com/premium-ai-image/high-speed-passeng...

[4] https://www.magnific.com/premium-ai-image/rail-yard-27_27291...

[5] https://www.magnific.com/premium-ai-image/train-track-with-s...

[6] https://pixabay.com/illustrations/ai-generated-train-tracks-...

Re: The 100k whys of AI

#90
post #89

Aw, it's just one big picture of book covers. You can't click on the books and read them. If they're AI-written, they're not copyrightable, so you could post the full text. Looking at the books side by side would be interesting. A test for AI-generated art: railroad tracks. For some reason, none of the image generators can get railroad trackage even close to correct. Just getting long, parallel rails correct seems to…

Periodic motions coupled with "whole image coherence" is still very difficult even for non-SD based models (NB, Flux, etc.)

I remembering being absolutely shocked when the gpt-image series managed to pass the Labyrinth test.

https://genai-showdown.specr.net/#the-labyrinth

Post reply on HN