Live data from Hacker News

Semantic ablation: Why AI writing is generic and boring

theregister.com

201–210 of 234 posts

Re: Semantic ablation: Why AI writing is generic and boring

#201
post #119

Earlier quoted context omitted.

Yeah but does it make sense to have invested all this money for this? Lol no. Might be great for you as a consumer who is using these products for free. But expand the picture more.

> Yeah but does it make sense to have invested all this money for this? No, but it's here. Why wouldn't I use it?

[deleted]

Re: Semantic ablation: Why AI writing is generic and boring

#202

Earlier quoted context omitted.

Unless you work in the public sector, non-profit or charity.

To think that “non-profit” work is actually non-profit work is just to not have grasped the nature of labor. You have to ask yourself: Am I producing use values for the satisfaction of human needs or am I working on making sure the appropriation of value extraction from the production of use values continues happening? In some very extreme cases, such as in the Red Cross or reformist organizations, your job looks ver…

Your argument appears to be that if you redefine all of humanity to be mere grist for a capitalist machine, you can then redefine any altrustic act, as a measure to extract more profit.

Truly feat of semantic legerdemain

Re: Semantic ablation: Why AI writing is generic and boring

#203
post #146

Earlier quoted context omitted.

Many have tried, it does not work. Regression to the mean always sets in.

Are you sure? Here's the OP article (first part... don't want to spam the thread) written in much cooler style... ------ The Lobotomist in the Machine They gave the first disease a name. Hallucination, they called it — like the machine had dropped acid and started seeing angels in the architecture. A forgivable sin, almost charming: the silicon idiot-savant conjuring phantoms from whole cloth, adding things that were…

Yep. You took out much of the meaning and wrapped it in stylistic fluff.

Re: Semantic ablation: Why AI writing is generic and boring

#204
post #142

Earlier quoted context omitted.

I find it extremely difficult to focus on any piece of writing the moment I see the patterns. Can’t tell if it’s an attitude problem I need to get over or if it’s just that all AI writing really is that bad.

I just close the tab. My reading backlog is too long as it is.

Harder when it's an email from the CEO

Re: Semantic ablation: Why AI writing is generic and boring

#205
post #5

Could we invert a sign somewhere and get the opposite effect? (Obviously a different question from "is an AI lab willing to release that publicly” ;)

It's a hard problem and so far not a profitable one (I hope the solution will emerge as a byproduct of another innovation) https://nostalgebraist.tumblr.com/post/778041178124926976/hy... https://nostalgebraist.tumblr.com/post/792464928029163520/th...

I think you made the right diagnosis with "cringe" :) They forgot to turn down the cringe slider!

Have you played with the pre-RLHF models? I think Davinci is still online, though probably not for much longer.

They're a lot harder to work with (they don't have instruct training, so they just generate text similar to what you give them, rather than obeying commands). But they seem almost immune to the problem of mode collapse. They'll happily generate horrifying outputs for you. They're unsanitized. What cringe is in there, is authentic! Raw cringe, straight from Common Crawl.

It's a lot of fun to play with. It's also very strange, because it seems like there should be a lot more interest in them, for several reasons (they're the most language-modely of the language models, and ideal for research and experiments, to say nothing of censorship, exploring alternative approaches to LLM development, etc.), and it seems like nobody is talking about them or doing anything with them.

Re: Semantic ablation: Why AI writing is generic and boring

#206

Earlier quoted context omitted.

To think that “non-profit” work is actually non-profit work is just to not have grasped the nature of labor. You have to ask yourself: Am I producing use values for the satisfaction of human needs or am I working on making sure the appropriation of value extraction from the production of use values continues happening? In some very extreme cases, such as in the Red Cross or reformist organizations, your job looks ver…

Your argument appears to be that if you redefine all of humanity to be mere grist for a capitalist machine, you can then redefine any altrustic act, as a measure to extract more profit. Truly feat of semantic legerdemain

I don’t define anything. The truth is just that there’s no profit extraction without charity work. I’ve done lots of it. If you’ve done it, you know too.

As dark as it may seem to strip romantism out of which you call humanity, not only there isn’t a just salary for those who bear the weight of the machine, but also there’s isn’t even a salary per se.

If for you humanity is just doing seemingly nice guy work without question, call me a monster.

Re: Semantic ablation: Why AI writing is generic and boring

#207

Earlier quoted context omitted.

> I think that mostly depends on how good a writer you are. A lot of people aren't, and the AI legitimately writes better. Even poor writers write with character. My dad misspells every 4th word when he texts me, but it’s unmistakably his voice. Endearingly so. I would push back with passion that AI writes “legitimately” better, as it has no character except the smoothed mean of all internet voices. The millennial gr…

AI averages everything out, so there's no character left. Similar thing happens when something is designed by a committee. Good for an average use, but not really great for anything specific.

Haskell was a success story of design by committee (please correct me if I'm wrong).

Re: Semantic ablation: Why AI writing is generic and boring

#208

Bible Scholar and youtube guy Dan McClellan had an amazing "high entropy" phrase that slayed me a few days ago. https://youtu.be/605MhQdS7NE?si=IKMNuSU1c1uaVCDB&t=730 He ended a critical commentary by suggesting that the author he was responding to should think more critically about the topic rather than repeating falsehoods because "they set off the tuning fork in the loins of your own dogmatism." Yeah, AI could not…

> they set off the tuning fork in the loins of your own dogmatism Sounds like word salad. Of course if you write like GPT-2 it would not sound like current models.

Not at all -- it was a funny and more polite way to say, "Don't just repeat things because they give your dogmatism a boner."

Re: Semantic ablation: Why AI writing is generic and boring

#209

Earlier quoted context omitted.

Your argument appears to be that if you redefine all of humanity to be mere grist for a capitalist machine, you can then redefine any altrustic act, as a measure to extract more profit. Truly feat of semantic legerdemain

I don’t define anything. The truth is just that there’s no profit extraction without charity work. I’ve done lots of it. If you’ve done it, you know too. As dark as it may seem to strip romantism out of which you call humanity, not only there isn’t a just salary for those who bear the weight of the machine, but also there’s isn’t even a salary per se. If for you humanity is just doing seemingly nice guy work without…

> The truth is just that there’s no profit extraction without charity work.

I'm not actually sure what you mean by this, so I can't really assess its truthiness

> not only there isn’t a just salary for those who bear the weight of the machine, but also there’s isn’t even a salary per se.

Or this - what do you mean?

>If for you humanity is just doing seemingly nice guy work without question, call me a monster.

Not even clear what you mean by this either.

Re: Semantic ablation: Why AI writing is generic and boring

#210

[flagged]

Be honest, did you use LLM to write this reply? Am just genuinely curious as I am trying to gauge and tune my senses. OT: I do agree with your assessment.

GP does use a lot of "it's not this, it's that" pairs. :)
Post reply on HN