The two big problems listed: * Thought-skipping as the primary lesion: models increasingly truncate or skip reasoning chains, explaining most of the error growth. * Popularity as a better indicator: the popularity, a non-semantic metric, of a tweet is a better indicator of the Brain Rot effect than the length in M1. That's what you'd expect. Popular culture content tends to jump from premise to conclusion without sho…
LLMs can get "brain rot"
291–300 of 310 posts
Re: LLMs can get "brain rot"
#292“Studying “Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI, guiding how we source, filter, and maintain training corpora so deployed systems stay sharp, reliable, and aligned over time.” An LLM-written line if I’ve ever seen one. Looks like the authors have their own brainrot to contend with.
If you weren't as incensed then, it's almost like your outrage and compulsion to post this on every hn thread is completely baseless.
Re: LLMs can get "brain rot"
#293Their starting portfolios are ludicrous. They are trading BTC, XRP, DOGE, etc. I thought the idea was somewhat interesting, but then I felt like the only reasonable takeaway I had was that these models have intense brainrot from consuming twitter, reddit, etc. and as such have a completely warped view of "finance".
Re: LLMs can get "brain rot"
#294“Studying “Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI, guiding how we source, filter, and maintain training corpora so deployed systems stay sharp, reliable, and aligned over time.” An LLM-written line if I’ve ever seen one. Looks like the authors have their own brainrot to contend with.
What is actually up with the "it's not just X, it's Y" cliche from LLMs? Supposedly these things are trained on all of the text on the internet yet this is not a phrasing I read pretty much anywhere, ever, outside of LLM content. Where are they getting this from?
But that just shifts the question to "what kind of reviewer actually likes 'it's not just X' cliche?" I have no idea.
Re: LLMs can get "brain rot"
#295Earlier quoted context omitted.
I've been doing that for decades. See for example https://www.mail-archive.com/kragen-tol@canonical.org/msg000... : > Many programming languages provide an exception facility that terminates subroutines without warning; although they usually provide a way to run cleanup code during the propagation of the exception (finally in Java and Python, unwind-protect in Common Lisp, dynamic-wind in Scheme, local variable destr…
It's less about the punctuation used, and more about the necessity of the punctuation used. In the sentence you provided, you make a series of points, link them together, and provide examples. If not an em dash, you would have required some other form of punctuation to communicate the same meaning The LLM, in comparison, communicated a single point with a similar amount of punctuation. If not an em dash- it could hav…
Em dashes are fine. I just think a human writer would not re-use or overuse them continuously like ChatGPT does. It feels natural to keep sentence structures varied (and I think it's something they teach in English comp)
Re: LLMs can get "brain rot"
#296Earlier quoted context omitted.
It's less about the punctuation used, and more about the necessity of the punctuation used. In the sentence you provided, you make a series of points, link them together, and provide examples. If not an em dash, you would have required some other form of punctuation to communicate the same meaning The LLM, in comparison, communicated a single point with a similar amount of punctuation. If not an em dash- it could hav…
Exactly, well said. Em dashes are fine. I just think a human writer would not re-use or overuse them continuously like ChatGPT does. It feels natural to keep sentence structures varied (and I think it's something they teach in English comp)
Re: LLMs can get "brain rot"
#297"Brain rot" is just the new term for "slang that old people don't understand". "Cool" and "for real" are no different than "rizz" and "no cap". You spoke "brain rot" once, and "cringed" when your parents didn't understand. The cycle repeats.
Re: LLMs can get "brain rot"
#298Earlier quoted context omitted.
Have you opened facebook recently? Seems the older folk are plenty affected to me.
But don't worry, us middle aged people are definitely immune.
Re: LLMs can get "brain rot"
#299Earlier quoted context omitted.
It is sad people study "brain rot" for LLMs but not for humans. If people were more engaged in cognitive hygiene for humans, many of the social media platforms would be very sane.
What do you base your claim on that people don't study that? I do not follow the research in that area but would find it highly unlikely there was no research into it.
What I am sad about is that some people spend time/worry about balancing some random weights of some LLMs for the sake of some "alignment" or whatever "brain rot". Aren't humans more important than LLMs ? Are we, as humans, that tied to LLMs ?
English is not my native language and I hope I made my point clearer.
Re: LLMs can get "brain rot"
#300Earlier quoted context omitted.
They didn't always em-dash. I expect it's intentional as a watermark. Other buzzwords you can spot are "wild" and "vibes".
I suspect it's a spandrel of some other feature of their training. Presumably em dashes occur disproportionately often in high-quality human-written text, so training LLMs to imitate high-quality human-written text instead of random IRC logs and 4chan trolls results in them also imitating high-quality typography.
Besides, LLMs' basin of high quality text is Wikipedia.