I personally think “generative AI” is a misnomer. More I understand the mathematics behind machine learning more I am convinced that it should not be used to generate text, images or anything that is meant for people to consume, even if it is the most blandest of email. Sometimes you might get lucky, but most of the time you only get what the most boring person in the most boring cocktail party would say if forced to…
Semantic ablation: Why AI writing is generic and boring
61–70 of 234 posts
Re: Semantic ablation: Why AI writing is generic and boring
#62Bible Scholar and youtube guy Dan McClellan had an amazing "high entropy" phrase that slayed me a few days ago. https://youtu.be/605MhQdS7NE?si=IKMNuSU1c1uaVCDB&t=730 He ended a critical commentary by suggesting that the author he was responding to should think more critically about the topic rather than repeating falsehoods because "they set off the tuning fork in the loins of your own dogmatism." Yeah, AI could not…
A sloppy mixed metaphor?
Re: Semantic ablation: Why AI writing is generic and boring
#63Earlier quoted context omitted.
I call it a mirage. I get why people are taken aback and fascinated by it. But what the model producers are chasing is a mirage. I wonder when they'll finally accept it?
[dead]
The real danger is the future investment needed to explore other architectures beyond LLMs. Will private firms be able to get the investment? Will public firms be granted the permission to do another round of large capex by investors? As time goes on, Apple's conservative approach means they will be the only firm trusted with its cash balance. They are very nicely seated despite all the furore they've had to endure.
Re: Semantic ablation: Why AI writing is generic and boring
#64Earlier quoted context omitted.
A sloppy mixed metaphor?
I'm learning to like 'em more, along with every other human idiosyncracy. Besides, it makes a kind of sense, the idea of some resonance occuring in one's gusset. Timber timbre. Flangent thrumming.
Re: Semantic ablation: Why AI writing is generic and boring
#65Re: Semantic ablation: Why AI writing is generic and boring
#66Earlier quoted context omitted.
It is an opinion piece. By a dude working as a "Professor of Pharmaceutical Technology and Biomaterials at the University of Ferrara". It has all the tropes of not understanding the underlying mechanisms, but repeating the common tropes. Quite ironic, considering what the author's intended "message" is. Jpeg -> jpeg -> jpeg bad. So llm -> llm -> llm must be bad, right? It reminds me of the media reception of that pap…
> Yet we're not seeing any collapse, despite models being trained mainly on synthetic data for the past 2 years. Maybe because researchers learned from the paper to avoid the collapse? Just awareness alone often helps to sidestep a problem.
Same with the "llms don't reason" from "Apple" (two interns working at Apple, but anyway). The media went nuts over it, even though it was littered with implementation mistakes and not worth the paper it was(n't) printed on.
Re: Semantic ablation: Why AI writing is generic and boring
#67Meh. Semantic Ablation - but toward a directed goal. If I say "How would Hemingway have said this, provided he had the same mindset he did post-war while writing for Collier's?" Then the model will look for clusters that don't fit what the model consider's to be Hemingway/Colliers/Post-War and suggest in that fashion. "edit this" -> blah "imagine Tom Wolfe took a bunch of cocaine and was getting paid by the word to p…
Re: Semantic ablation: Why AI writing is generic and boring
#68Re: Semantic ablation: Why AI writing is generic and boring
#69Earlier quoted context omitted.
I'm learning to like 'em more, along with every other human idiosyncracy. Besides, it makes a kind of sense, the idea of some resonance occuring in one's gusset. Timber timbre. Flangent thrumming.
Tuning fork in loins just makes me think of that chess cheating scandal with a vibrating butt plug.