There have been good discussions recently about preventing AIs from being too sycophantic. There have been some dangerous moments where LLMs would praise every idea the user has as genius, ground-breaking, and a brilliant observation. Some academics have reported a noticeable increase in the volume of crackpot emails they get daily. They're full of LLM-generated nonsense, where the AI goes along with the nonsensical…
> Most of the time it's pretty harmless I think we have to stop the idea that wasting people's time at such high scale is harmless. It's not.
I let Claude Code write an entire book
11–20 of 84 posts
Re: I let Claude Code write an entire book
#12Re: I let Claude Code write an entire book
#13> The second insight is that human hallucinations are fundamentally social. Unlike AI, which hallucinates in isolation, humans hallucinate collaboratively. At the dinner party, each false fact was immediately reinforced by social validation. The nods, the interested expressions, the follow-up comments - all of these served to solidify the hallucination into shared "knowledge." Oh boy, that burns - the Futuristic AI d…
Its the issue of reward function, both humans and LLMs are trained on pleasing clients as one of major goal.
Re: I let Claude Code write an entire book
#14> The second insight is that human hallucinations are fundamentally social. Unlike AI, which hallucinates in isolation, humans hallucinate collaboratively. At the dinner party, each false fact was immediately reinforced by social validation. The nods, the interested expressions, the follow-up comments - all of these served to solidify the hallucination into shared "knowledge." Oh boy, that burns - the Futuristic AI d…
I feel like we do a great job of that already and the internet is full of people pointing it out from others.
Re: I let Claude Code write an entire book
#15Did you read it tho? We might be approaching a time when saying an author has written more books than they've read might turn from a joke to a fact.
The actual author is Claude, and Claude has read a lot of books.
Re: I let Claude Code write an entire book
#16Re: I let Claude Code write an entire book
#17> The second insight is that human hallucinations are fundamentally social. Unlike AI, which hallucinates in isolation, humans hallucinate collaboratively. At the dinner party, each false fact was immediately reinforced by social validation. The nods, the interested expressions, the follow-up comments - all of these served to solidify the hallucination into shared "knowledge." Oh boy, that burns - the Futuristic AI d…
Re: I let Claude Code write an entire book
#18As a writer, this is deeply comforting. The book is total shit. It sounds like an AI, not like something a person would connect with for even a moment. Not even in the opening lines.
When you've read it in its entirety, could you indicate on a scale from 1 to 10 what score it would get compared to published books you've read (including of course all the best and the worst ones)?
Re: I let Claude Code write an entire book
#19Not only by scholars and experts. Literally 50% of Internet discussion is about biases, selective facts, spin etc. The problem with "AI" is that propaganda can be automated and that it wastes our time.
The topic is suited for "AI" because it is a soft topic that lends itself to uninhibited preaching. "AI" is also great at writing presidential speeches. It is probably the only thing it is good at.
Nevertheless, the result is still painful to read.
Re: I let Claude Code write an entire book
#20Earlier quoted context omitted.
> Most of the time it's pretty harmless I think we have to stop the idea that wasting people's time at such high scale is harmless. It's not.
Reminds me of Google's Doodles, which must have annoyed millions of people and wasted millions of minutes worldwide, and don't get me started on ads.