Live data from Hacker News

LLMs can get "brain rot"

llm-brain-rot.github.io

291–300 of 310 posts

Re: LLMs can get "brain rot"

#291

The two big problems listed: * Thought-skipping as the primary lesion: models increasingly truncate or skip reasoning chains, explaining most of the error growth. * Popularity as a better indicator: the popularity, a non-semantic metric, of a tweet is a better indicator of the Brain Rot effect than the length in M1. That's what you'd expect. Popular culture content tends to jump from premise to conclusion without sho…

[deleted]

Re: LLMs can get "brain rot"

#292
post #47

“Studying “Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI, guiding how we source, filter, and maintain training corpora so deployed systems stay sharp, reliable, and aligned over time.” An LLM-written line if I’ve ever seen one. Looks like the authors have their own brainrot to contend with.

Im curious where all you top commenters were 5 years ago when grammarly was a product used by most professional writers.

If you weren't as incensed then, it's almost like your outrage and compulsion to post this on every hn thread is completely baseless.

Re: LLMs can get "brain rot"

#293
Speaking of, someone shared with me an AI financial challenge where they are pitting the LLMs against one another to make trades, manage risk, etc. and then track their performance against one another with starting capital of 10,000 USD each.

Their starting portfolios are ludicrous. They are trading BTC, XRP, DOGE, etc. I thought the idea was somewhat interesting, but then I felt like the only reasonable takeaway I had was that these models have intense brainrot from consuming twitter, reddit, etc. and as such have a completely warped view of "finance".

Re: LLMs can get "brain rot"

#294
post #137
post #47

“Studying “Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI, guiding how we source, filter, and maintain training corpora so deployed systems stay sharp, reliable, and aligned over time.” An LLM-written line if I’ve ever seen one. Looks like the authors have their own brainrot to contend with.

What is actually up with the "it's not just X, it's Y" cliche from LLMs? Supposedly these things are trained on all of the text on the internet yet this is not a phrasing I read pretty much anywhere, ever, outside of LLM content. Where are they getting this from?

It's probably getting amplified by the RLHF stage because the earlier models didn't do that.

But that just shifts the question to "what kind of reviewer actually likes 'it's not just X' cliche?" I have no idea.

Re: LLMs can get "brain rot"

#295
post #277
post #247

Earlier quoted context omitted.

I've been doing that for decades. See for example https://www.mail-archive.com/kragen-tol@canonical.org/msg000... : > Many programming languages provide an exception facility that terminates subroutines without warning; although they usually provide a way to run cleanup code during the propagation of the exception (finally in Java and Python, unwind-protect in Common Lisp, dynamic-wind in Scheme, local variable destr…

It's less about the punctuation used, and more about the necessity of the punctuation used. In the sentence you provided, you make a series of points, link them together, and provide examples. If not an em dash, you would have required some other form of punctuation to communicate the same meaning The LLM, in comparison, communicated a single point with a similar amount of punctuation. If not an em dash- it could hav…

Exactly, well said.

Em dashes are fine. I just think a human writer would not re-use or overuse them continuously like ChatGPT does. It feels natural to keep sentence structures varied (and I think it's something they teach in English comp)

Re: LLMs can get "brain rot"

#296
post #277

Earlier quoted context omitted.

It's less about the punctuation used, and more about the necessity of the punctuation used. In the sentence you provided, you make a series of points, link them together, and provide examples. If not an em dash, you would have required some other form of punctuation to communicate the same meaning The LLM, in comparison, communicated a single point with a similar amount of punctuation. If not an em dash- it could hav…

Exactly, well said. Em dashes are fine. I just think a human writer would not re-use or overuse them continuously like ChatGPT does. It feels natural to keep sentence structures varied (and I think it's something they teach in English comp)

You're absolutely right! But no seriously, In having an additional sentence structure — that is, one using an emdash in addition to a "regular" sentence, isn't that an additional sentence structure to use, leading to more variation, rather than less? (I'd "delve" into the subject but I don't have more to say.)

Re: LLMs can get "brain rot"

#297
post #91

"Brain rot" is just the new term for "slang that old people don't understand". "Cool" and "for real" are no different than "rizz" and "no cap". You spoke "brain rot" once, and "cringed" when your parents didn't understand. The cycle repeats.

Based on my hobby of collecting old gaming magazines, I think 1980s UK had the best slang.

Re: LLMs can get "brain rot"

#298
post #38

Earlier quoted context omitted.

Have you opened facebook recently? Seems the older folk are plenty affected to me.

But don't worry, us middle aged people are definitely immune.

Hahaha, I’m 35. Ut I feel myself getting crazier every day for sure… but at least I try and stay away from too much brain rot…

Re: LLMs can get "brain rot"

#299
post #207

Earlier quoted context omitted.

It is sad people study "brain rot" for LLMs but not for humans. If people were more engaged in cognitive hygiene for humans, many of the social media platforms would be very sane.

What do you base your claim on that people don't study that? I do not follow the research in that area but would find it highly unlikely there was no research into it.

I did not express myself correctly, but you are kinda right. Expressed more correctly, the point I was trying to make is that the cognitive hygiene seems more mainstream/important for LLMs than for humans. There are studies of course of human "brain rot" such as this one : https://publichealthpolicyjournal.com/mit-study-finds-artifi...

What I am sad about is that some people spend time/worry about balancing some random weights of some LLMs for the sake of some "alignment" or whatever "brain rot". Aren't humans more important than LLMs ? Are we, as humans, that tied to LLMs ?

English is not my native language and I hope I made my point clearer.

Re: LLMs can get "brain rot"

#300
post #251

Earlier quoted context omitted.

They didn't always em-dash. I expect it's intentional as a watermark. Other buzzwords you can spot are "wild" and "vibes".

I suspect it's a spandrel of some other feature of their training. Presumably em dashes occur disproportionately often in high-quality human-written text, so training LLMs to imitate high-quality human-written text instead of random IRC logs and 4chan trolls results in them also imitating high-quality typography.

Nah, because it's new. 3.5 didn't emdash and I don't think 4 even did.

Besides, LLMs' basin of high quality text is Wikipedia.

Post reply on HN