Live data from Hacker News

Semantic ablation: Why AI writing is generic and boring

theregister.com

61–70 of 234 posts

Re: Semantic ablation: Why AI writing is generic and boring

#61

I personally think “generative AI” is a misnomer. More I understand the mathematics behind machine learning more I am convinced that it should not be used to generate text, images or anything that is meant for people to consume, even if it is the most blandest of email. Sometimes you might get lucky, but most of the time you only get what the most boring person in the most boring cocktail party would say if forced to…

Regurgitative AI

Re: Semantic ablation: Why AI writing is generic and boring

#62

Bible Scholar and youtube guy Dan McClellan had an amazing "high entropy" phrase that slayed me a few days ago. https://youtu.be/605MhQdS7NE?si=IKMNuSU1c1uaVCDB&t=730 He ended a critical commentary by suggesting that the author he was responding to should think more critically about the topic rather than repeating falsehoods because "they set off the tuning fork in the loins of your own dogmatism." Yeah, AI could not…

A sloppy mixed metaphor?

I'm learning to like 'em more, along with every other human idiosyncracy. Besides, it makes a kind of sense, the idea of some resonance occuring in one's gusset. Timber timbre. Flangent thrumming.

Re: Semantic ablation: Why AI writing is generic and boring

#63
post #48

Earlier quoted context omitted.

I call it a mirage. I get why people are taken aback and fascinated by it. But what the model producers are chasing is a mirage. I wonder when they'll finally accept it?

[dead]

To me LLMs are an experiment toward replication of what humans can do. However, they fall short on many dimensions that its just not going to pan out from what I see.

The real danger is the future investment needed to explore other architectures beyond LLMs. Will private firms be able to get the investment? Will public firms be granted the permission to do another round of large capex by investors? As time goes on, Apple's conservative approach means they will be the only firm trusted with its cash balance. They are very nicely seated despite all the furore they've had to endure.

Re: Semantic ablation: Why AI writing is generic and boring

#64

Earlier quoted context omitted.

A sloppy mixed metaphor?

I'm learning to like 'em more, along with every other human idiosyncracy. Besides, it makes a kind of sense, the idea of some resonance occuring in one's gusset. Timber timbre. Flangent thrumming.

Tuning fork in loins just makes me think of that chess cheating scandal with a vibrating butt plug.

Re: Semantic ablation: Why AI writing is generic and boring

#66

Earlier quoted context omitted.

It is an opinion piece. By a dude working as a "Professor of Pharmaceutical Technology and Biomaterials at the University of Ferrara". It has all the tropes of not understanding the underlying mechanisms, but repeating the common tropes. Quite ironic, considering what the author's intended "message" is. Jpeg -> jpeg -> jpeg bad. So llm -> llm -> llm must be bad, right? It reminds me of the media reception of that pap…

> Yet we're not seeing any collapse, despite models being trained mainly on synthetic data for the past 2 years. Maybe because researchers learned from the paper to avoid the collapse? Just awareness alone often helps to sidestep a problem.

No one did what the paper actually proposed. It was a nothing burger in the industry. Yet it was insanely popular on social media.

Same with the "llms don't reason" from "Apple" (two interns working at Apple, but anyway). The media went nuts over it, even though it was littered with implementation mistakes and not worth the paper it was(n't) printed on.

Re: Semantic ablation: Why AI writing is generic and boring

#67

Meh. Semantic Ablation - but toward a directed goal. If I say "How would Hemingway have said this, provided he had the same mindset he did post-war while writing for Collier's?" Then the model will look for clusters that don't fit what the model consider's to be Hemingway/Colliers/Post-War and suggest in that fashion. "edit this" -> blah "imagine Tom Wolfe took a bunch of cocaine and was getting paid by the word to p…

These kinds of prompts don’t really improve the writing IME. It still gets riddled with the same tropes and phrases, or it veers off into textual vomit.

Re: Semantic ablation: Why AI writing is generic and boring

#69

Earlier quoted context omitted.

I'm learning to like 'em more, along with every other human idiosyncracy. Besides, it makes a kind of sense, the idea of some resonance occuring in one's gusset. Timber timbre. Flangent thrumming.

Tuning fork in loins just makes me think of that chess cheating scandal with a vibrating butt plug.

It just makes me think of that time I saw someone recovering from eye surgery and I had a visceral reaction.
Post reply on HN