Live data from Hacker News

The revolt of the reader

bcantrill.dtrace.org

271–280 of 313 posts

Re: The revolt of the reader

#271
i think the biggest tell is that LLMs talk like a politician. They blather on while beating around the bush. It takes 5 paragraphs to convey one sentence of information.

I dont care about llm use on any ideological grounds, or believe its a voiding of the social contract like the author of this piece does. I think its just a tool. However a lot of people use the tool really badly.

Re: The revolt of the reader

#272

Seems like it's a cat and mouse game that won't end anytime soon. LLMs are constantly getting better at writing, so at some point people won't be able to tell reliably tell the difference anymore. I wouldn't laude Pangram so highly at this point, since we're not at the final round yet.

I'm not absolutely opposed to AI in principle. If it writes things worth reading, I'm not opposed to reading them. The problem is when it writes things that have the appearance of making sense but actually don't, when it writes what could be better put in 10% of the words, when it writes with no coherent logic. I don't have the time or the mental energy to wade through that on the faint chance that there might be a g…

I agree completely, but how does that relate to my comment (saying it's cat and mouse, the game may never end, and Pangram's current success isn't indicative of future value)?

Re: The revolt of the reader

#273

Earlier quoted context omitted.

> " My revolt is against the cognitive stress of reading generated text. " I saw a comment on HN that that was roughly "re: ChatGPT, when I write one sentence and I get back three screens of lecture, I don't consider that a 'chat'". I consider that comment often when prompting Claude and hoping for a two line response and getting an "it's important to note that ". At some point it may as well be the teacher in a Char…

Telling LLMs to be concise works. > Reword this concisely: > I returned and saw under the sun, that the race is not to the swift, nor the battle to the strong, neither yet bread to the wise, nor yet riches to men of understanding, nor yet favor to men of skill; but time and chance happeneth to them all. > Ultra-concise: Talent and effort don't guarantee success; luck and timing happen to everyone. > Punchy: The best…

Concise helps clarity, but notice what still is lost. The original version used multiple perspectives to illustrate the point. It invites consideration, putting yourself in the shoes of each person before the "twist" is applied to each. It makes the point more visceral and memorable because it is (slightly) lived instead of told.

This is the difference between writing to convince a broad audience and writing to explain a point. AI can summarize well but until we can contextualize a richer framework for human comprehension, LLMs will struggle to resonate.

Re: The revolt of the reader

#274
post #73

Disclaimer: I do not like to read LLM-generated text any more than anyone else. IMHO a big problem with Pangram in particular is that they market it as a reliable tool that can be used to catch students cheating. This can obviously have disastrous effects on young lives, because it is not as reliable as they suggest. Per their own benchmarks, they do not achieve 100% accuracy even on text that is published on the Int…

I don't think 100% accuracy is logically possible. Because it's entirely possible that someone would just naturally write the exact same thing as an LLM would write. And after the fact there is no way to distinguish the two. But pangram does have an extremely low false positive rate, which I think does make it useful for detecting cheating students. Assuming the base rate of cheating students is 1%, and assuming pangram has a false positive rate of 1 in 10,000 and a true positive rate of 7,000 in 10,000, that means ~98% of students flagged by pangram actually cheated. Combined with a teacher's familiarity with that student's previous work, which should rule out many more false positives, it should be a very useful tool.

Re: The revolt of the reader

#275

Earlier quoted context omitted.

In contemporary YouTube-script wording: > The Ecclasiast looked under the sun, but there was something he didn't understand. Something that wasn't right. Something that was not as it was supposed to be. And here is what the Ecclesiast didn't understand. Here is what nobody understood. Not then. Not in the years that followed. Not now. It was not the swift who won the race. Not the strong who won the battle. Not the w…

That one starts with a glaring hallucination "he didn't understand, nobody understood, not then or now...". But the second part is IMO better than the Ecclasiast, which has outdated phrasing ("nor yet riches to men of understanding"). > When I look under the sun, it's not the swift who win races, nor the strong who win battles, nor the wise who earn bread, nor the smart who gain riches, nor the skilled who gain favor…

The construction of meaning is totally distorted, though. In the original, the first part is entirely motivated by the conclusion, and puts emphasis to this by a crescendo of counterintuitive observations. This is what made this memorable phrasing. In the version suggested here, there's just an incompetence attributed to the original author, underlined by repetitive phrasing, so that the supposed speaker may claim all the glory by uttering an observation, which is in and by itself rather banal. You wont think about this twice. Thus, the entire construct ends in a whimper (so it may fit the template) and there isn't really any reason to put it that way, or to say this, in the first place. Its perceived purpose may be rather to occupy space and time (at the cost of the recipient.)

Re: The revolt of the reader

#276

> do you think readers can’t tell? No. I have good anecdata: readers cannot reliably distinguish my own prose from LLM-written one apart from cases where LLMs use odd metaphors or one of their specific patterns. I've been specifically experimenting with that.

Yeah, when I read this sentence I thought, "well, maybe you're just incorrectly classifying non-obvious LLM writing as human writing, which makes your hypothesis unfalsifiable".

Re: The revolt of the reader

#277

> Today, legitimate businesses are very careful about how they use bulk e-mail I don’t think this is remotely true. Sure, they’re legally obliged to let you unsubscribe, and sure, it’s not dick pills, but every US company will immediately send you a newsletter when you purchase something, review requests and, if they/you use Shop for checkout, expect an abandoned cart reminder. PR pieces and software companies don’t…

Not sending you anything before you make a purchase and providing the unsubscribe option are MAJOR changes from before. Some sites even give you an option at checkout to not have them email you. That is businesses being very careful. In ye olden days you'd get email from all kinds of businesses and scammers completely unsolicited and out of the blue with no way to tell them to stop. It was overwhelming and awful. Things are much better than they used to be. Still somewhat annoying? Absolutely. But much much better.

Re: The revolt of the reader

#278
post #120

My revolt is against the cognitive stress of reading generated text. A trope typically indicates I’m in for an uphill read. I recently read this William Zinsser quote that inspired a nickname for this: Clotted Claude [1]. > Nobody has made the point better than George Orwell in his translation into modern bureaucratic fuzz of this famous verse from Ecclesiastes: > > I returned and saw under the sun, that the race is…

I think Orwell did a great job there actually. Despite its bizarre look, the sentence is evocative and eloquent. It does make me get a clear mental image from the very first word. It leaves little room for roaming and guessing, as it firmly nails elements one by one, and, by the time I reach the end of the sentence, I get the full meaning almost immediately. This sentence is not randomly written; this is crafted with…

> Despite its bizarre look, the sentence is evocative and eloquent.

No it isn't. It trades concrete imagery for empty abstractions which could encompass just about anything and are basically meaningless.

If you think this is good writing, you need a serious detox from corporate America.

Re: The revolt of the reader

#279

Earlier quoted context omitted.

When I read the Orwell's version, I immediately had the same feeling I had when reading mathematical proofs. I hate so much to hunt the preceding text for anaphora resolution... It's just such a bad and pretentious way of writing. It's hostile to the reader with the side of flaunting author's superiority. It's like having to sit through a party with acclaimed academics: every single one is so full of themselves, they…

I agree that it's not great style for just conveying information clearly and plainly (e.g I'd hate to read documentation written like this) but I'd argue that here, the medium is part of the message. It's supposed to sound dry and depressing and somewhat sterile. > It's hostile to the reader with the side of flaunting author's superiority. I think if someone deliberately obfuscates meaning to sound fancier when the p…

I disagree. There is plenty of writing that operates at the same level of abstraction (philosophy, mathematics) without being needlessly convoluted.

Orwell is a master precisely because he understood language deeply enough to be able to produce a monstrosity on both the level of content (undue abstraction) and structure (winding, breathless syntax).

Re: The revolt of the reader

#280
post #73

Disclaimer: I do not like to read LLM-generated text any more than anyone else. IMHO a big problem with Pangram in particular is that they market it as a reliable tool that can be used to catch students cheating. This can obviously have disastrous effects on young lives, because it is not as reliable as they suggest. Per their own benchmarks, they do not achieve 100% accuracy even on text that is published on the Int…

The false positive rate for Pangram 4 is something like one in 24,000.[0] To put that in perspective, the wrongful-conviction (false positive rate) for death-sentenced defendants in the US is estimated conservatively to be around 4.1%.[1] The FP rate for death-sentence convictions is 1,000 times bigger than Pangram’s FP rate.

Now, the US criminal system is not a great yardstick for justice. But it goes to show you Pangram is really good evidence that something was LLM generated. It can be an amazing tool for enforcing AI policies in schools, and there ought to be ways to use it with caveats for the rare but inevitable false positives (appeals, etc).

[0]: see page 15 https://arxiv.org/pdf/2607.27183 [1]: see https://pmc.ncbi.nlm.nih.gov/articles/PMC4034186/

Post reply on HN