261–270 of 310 posts
So they trained LLM's on a bunch of junk and then notice that it got worse? I don't understand how that's a surprising, or even interesting result?
And while this result isn't extraordinary, it definitely creates knowledge and could close the gap to more interesting observations.
“Studying “Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI, guiding how we source, filter, and maintain training corpora so deployed systems stay sharp, reliable, and aligned over time.” An LLM-written line if I’ve ever seen one. Looks like the authors have their own brainrot to contend with.
Earlier quoted context omitted.
I've been doing that for decades. See for example https://www.mail-archive.com/kragen-tol@canonical.org/msg000... : > Many programming languages provide an exception facility that terminates subroutines without warning; although they usually provide a way to run cleanup code during the propagation of the exception (finally in Java and Python, unwind-protect in Common Lisp, dynamic-wind in Scheme, local variable destr…
Yeah that's a bit maddening because this common usage is exactly why LLMs adopted the pattern. Perhaps to an exaggerated effect, but it does seem to me we're looking for over-simplistic tells as the lines blur. And LLM output dictating how we use language seems backwards.
“Studying “Brain Rot” for LLMs isn’t just a catchy metaphor—it reframes data curation as cognitive hygiene for AI, guiding how we source, filter, and maintain training corpora so deployed systems stay sharp, reliable, and aligned over time.” An LLM-written line if I’ve ever seen one. Looks like the authors have their own brainrot to contend with.
I think using large language models really accelerates mental atrophy. It's like when you use an input method for a long time, it automatically completes words for you, and then one day when you pick up a pen to write, you find you can't remember how to spell the words. However, the main point in the article is that we need to feed high-quality data to large language models. This view is actually a consensus, isn't i…
There's this double standard. Slop is bad for models. Keep it out of the models at all costs! They cannot wait to put it into my head though. They don't care about my head.
Earlier quoted context omitted.
That is indeed an LLM-written sentence — not only does it employ an em dash, but also lists objects in a series — twice within the same sentence — typical LLM behavior that renders its output conspicuous, obvious, and readily apparent to HN readers.
I've been doing that for decades. See for example https://www.mail-archive.com/kragen-tol@canonical.org/msg000... : > Many programming languages provide an exception facility that terminates subroutines without warning; although they usually provide a way to run cleanup code during the propagation of the exception (finally in Java and Python, unwind-protect in Common Lisp, dynamic-wind in Scheme, local variable destr…
Earlier quoted context omitted.
Same here. I recently learned it was an LLM thing, and I've been using them forever. Also relevant: https://news.ycombinator.com/item?id=45226150
its not an llm thing -- its just -- folks don't know how to use them (pun intended). Same for ; "" vs '', ex, eg, fe, etc. and so many more. I like em all, but I'm crazy.
Interesting, I have never encountered this initialism in the wild, to my recollection: https://en.wiktionary.org/wiki/f.e.#English
Earlier quoted context omitted.
They also tried to heal the damage, to partial avail. Besides, it's science: you need to test your hypotheses empirically. Also, to draw attention to the issue among researchers, performing a study and sharing your results is possibly the best way.
I don’t understand, so this is just about training an LLM with bad data and just having a bad LLM? just use a different model? dont train it with bad data and just start a new session if your RAG muffins went off the rails? what am I missing here
Earlier quoted context omitted.
HR people have been speaking that way long before LLMs. Did you already update and align your OKR’s? Is your career accelerating from 360 degree peer review, continuous improvement, competency management, and excellence in execution? Do you review your goals daily, with regular 1-on-1 discussions with your Manager?
“360 degree peer review” isn’t a thing, the whole idea is that a 360 includes feedback from both your manager and your peers, that’s what distinguishes it from a 180! :)
I was once 'asked' to rate all my colleagues in a excel sheet so HR had 'something to base their evaluation on' smh