Live data from Hacker News

Semantic ablation: Why AI writing is generic and boring

theregister.com

81–90 of 234 posts

Re: Semantic ablation: Why AI writing is generic and boring

#81
the word choice here is so obtuse as to trigger my radar for "is this some kind of parody where this itself was AI generated". it appears to be entirely serious, which is disappointing, it could have been high art.

the words TFA is looking for is mode collapse https://www.lesswrong.com/posts/t9svvNPNmFf5Qa3TA/mysteries-... and the author could herself learn to write more clearly.

Re: Semantic ablation: Why AI writing is generic and boring

#83
post #68
post #34

Earlier quoted context omitted.

Eh, it's not __that__ simple.

It is, just don’t use a thing with no soul like ai if soul is what you’re after.

The point is that he may not using AI in any shape or form, Regardless, AI scrapes its work without explicit consent and then spits it back in "polished" soul free form.

Re: Semantic ablation: Why AI writing is generic and boring

#84
post #3

This is a good statement of what I suspect many of us have found when rejecting the rewriting advice of AIs. The "pointiness" of prose gets worn away, until it doesn't say much. Everything is softened. The distinctiveness of the human voice is converted into blandness. The AI even says its preferred rephrasing is "polished" - a term which specifically means the jaggedness has been removed. But it's the jagged edges,…

I think that mostly depends on how good a writer you are. A lot of people aren't, and the AI legitimately writes better. As in, the prose is easier to understand, free of obvious errors or ambiguities.

But then, the writing is also never great. I've tried a couple of times to get it to write in the style of a famous author, sometimes pasting in some example text to model the output on, but it never sounds right.

Re: Semantic ablation: Why AI writing is generic and boring

#85

Couldn't you simply increase the temperature of the model to somewhat mitigate this effect?

you have to know that your "simply" is carrying too much weight. here's some examples of why just temperature is not enough, you need to run active world models https://www.latent.space/p/adversarial-reasoning

Re: Semantic ablation: Why AI writing is generic and boring

#86
I wonder how much of it could be prompted away.

For example the anthropic Frontend Design skill instructs:

"Typography: Choose fonts that are beautiful, unique, and interesting. Avoid generic fonts like Arial and Inter; opt instead for distinctive choices that elevate the frontend's aesthetics; unexpected, characterful font choices. Pair a distinctive display font with a refined body font."

Or

"NEVER use generic AI-generated aesthetics like overused font families (Inter, Roboto, Arial, system fonts), cliched color schemes (particularly purple gradients on white backgrounds), predictable layouts and component patterns, and cookie-cutter design that lacks context-specific character." 1

Maybe sth similar would be possible for writing nuances.

1 https://github.com/anthropics/skills/blob/main/skills/fronte...

Re: Semantic ablation: Why AI writing is generic and boring

#87
post #28

Nonsense. I’ve written bland prose for a story and AI made it much better by revising it with a prompt such as this: “Make the vocabulary and grammar more sophisticated and add in interesting metaphors. Rewrite it in the style of a successful literary author.” Etc.

[dead]

I have a colleague that recently self-published a book. I can easily tell which parts were LLM driven and which parts represent his own voice. Just like you can tell who's in the next stall in the bathroom at work after hearing just a grunt and a fart. And THAT is a sentence an LLM would not write.

Re: Semantic ablation: Why AI writing is generic and boring

#89
post #84
post #3

This is a good statement of what I suspect many of us have found when rejecting the rewriting advice of AIs. The "pointiness" of prose gets worn away, until it doesn't say much. Everything is softened. The distinctiveness of the human voice is converted into blandness. The AI even says its preferred rephrasing is "polished" - a term which specifically means the jaggedness has been removed. But it's the jagged edges,…

I think that mostly depends on how good a writer you are. A lot of people aren't, and the AI legitimately writes better. As in, the prose is easier to understand, free of obvious errors or ambiguities. But then, the writing is also never great. I've tried a couple of times to get it to write in the style of a famous author, sometimes pasting in some example text to model the output on, but it never sounds right.

I find most people can write way better than AI, they simply don’t put in the effort.

Which is the real issue, we’re flooding channels not designed for such low effort submissions. AI slop is just SPAM in a different context.

Re: Semantic ablation: Why AI writing is generic and boring

#90

Earlier quoted context omitted.

I mean there's tons of better-writing tools that use AI like Grammarly etc. For actual general-purpose LLMs, I don't think there's much incentive in making it write "better" in the artistic sense of the world... if the idea is to make the model good at tasks in general and communicate via language, that language should sound generic and boring. If it's too artistic or poetic or novel-like, the communication would app…

I wish it would just say "k, updated xyz to 1.2.3 in Cargo.toml" instead of the entire pages it likes to output. I don't want to read all of that!

I used to feel the same but you can just prompt it to reply with only one word when its done. Most people prefer it to summarize because its easier to track so ig thats the natural default
Post reply on HN