Earlier quoted context omitted.
On a similar note: on Steam, the original Dark Souls game[1] is listed with the "souls-like" tag. That's not wrong , I guess, but just kind of a tautology. Grice's maxims[2] generally have such tautologies omitted in ordinary conversation as non-informative. [1]: https://store.steampowered.com/app/570940/DARK_SOULS_REMASTE... [2]: https://en.wikipedia.org/wiki/Cooperative_principle
I really thought ChatGPT would be able to tell me what this is called but it can't. I suggest "circular eponym". It's like calling a CRT monitor a really big flatscreen.
Quality non-fiction books are the antithesis of AI slop
251–260 of 265 posts
Re: Quality non-fiction books are the antithesis of AI slop
#252Re: Quality non-fiction books are the antithesis of AI slop
#253Not to be intentionally contrarian, but I have thought a lot about this: I think good fiction is actually the antithesis of AI, fundamentally. LLMs are really only capable of combining different things into output. This can give you some creative results, but it is ultimately kind of limited. I cannot imagine that prompting an AI a thousand times would give you something truly original in the way many high-quality fi…
Re: Quality non-fiction books are the antithesis of AI slop
#254Earlier quoted context omitted.
So only people who have fought in wars can write novels about fighting in wars?
If the aim is to have actual knowledge of the experience, then yes. Of course not all works need to be this way, and many, many books are written about war by people that haven't been in it. The broader point is that LLMs cannot have original experiences.
Implication is that virtually none of the novels ever written which include wars are actually original works, since vanishingly few novelists have been in active wars.
Maybe originality just doesn't mean much then?
Re: Quality non-fiction books are the antithesis of AI slop
#255Earlier quoted context omitted.
Just because the form of a story is the same as another story does not imply that the content is interchangeable. I could write you a story right now about being an expat living in Poland in 2026. It’s unclear to me how an LLM would have the cultural knowledge or experience to write such a story that is actually accurate and up to date, without already having something like my story already in its dataset.
Yeah but you would just be doing the same thing: mashing up some known information about humans and Poland. You would pick plausible names like Marek or Piotr, plausible places like Warsaw or Gdansk, and some random flavour of story that is either completely general across cultures (hero's journey) or some local tale from Poland. Shakespeare did the same, so I wouldn't blame you for it.
Re: Quality non-fiction books are the antithesis of AI slop
#256Earlier quoted context omitted.
> while an AI has only "data that mirrors" experiences. True for a lot of current AI. With more robotic bodies, loads more access to cameras/audio/satellite/science measurements, an AI can have original experience on a level that can only be described as god-like compared to humans.
You could argue AI already partly has access to these measurements. You could easily tap into smart sensor data etc, same voor video/audio etc. The part that AI can't (yet) truly replicate is 'feelings/emotions'. Experiences such feeling dread, loneliness, happiness. Or being anxious, nervous or having goosebumps. You can describe all these states but they are differently experienced for each individual and also depe…
Re: Quality non-fiction books are the antithesis of AI slop
#257I don't think we would have AI slop, if they were just trained on high quality media. Less relatable AI, maybe, but not sloppy AI. AI trained on other AI (i.e. distilling), can be better than the AI they were trained on, likely because of this reason. Each iteration can raise the bar. As apposed to the deep spiral of generating shiny attention crystals for humans, and then training on that.
Training AI on AI will most likely increase slop. LLM's add randomness in their outputs, books usually don't.
Obviously, you can handicap any model with an indiscriminate dataset. Are you training on slop? Why?
More data is not automatically better data.
Just three (of many) advantages of quality data selection: (1) It gives a clearer signal. (2) It, ironically, reduces the complexity of what needs to be learned, since slop adds its own complexity. (3) It reduces dataset size which means more learning per watt (and per just about any other cost). The advantages compound.
Humans are no different. Children surprise with their ability to absorb sophisticated relationships and skills, while people who had bad examples struggle to recover.
99% of human effective intelligence is higher quality cultural knowledge learned as children. None of us had to spend centuries deciding whether zero, negative numbers, the square root of -1 are numbers. Slop + quality is not quality.
Re: Quality non-fiction books are the antithesis of AI slop
#258Earlier quoted context omitted.
No, it's the same as a camera recording it and digesting it.
A camera has thoughts? An interior life? Friends?
Re: Quality non-fiction books are the antithesis of AI slop
#259Earlier quoted context omitted.
I bought a tiny e-reader [0] and carry that as well as my phone. When the temptation to doomscroll triggers, I pull out the e-reader instead and read a book. I tried attaching the book to the phone as their marketing suggests, but that didn't click somehow. Having both out means I would check the phone and then not look at the book. Working so far, but it's only been a couple of weeks, so let's see. [0] after reading…
Yea, for me my Kindle just didnt work. I always have had one since they were first released, but it was always hard to keep the habit between book. Having a nice library of paper books, for whatever reason, has worked a lot better for me. I think it’s passively seeing them around the house and in the background always considering what is next. This last round I couldn’t decide what to dig in to after I’d finished Tru…
I used to have paper books. But I found they were just a massive pain in the arse to carry around, and move. They became very expensive, very inconvenient wallpaper. I gave them all away to a charity shop and bought an e-reader instead. Now I carry around 250 books in my pocket wherever I go. It's liberating.
Re: Quality non-fiction books are the antithesis of AI slop
#260I've been really exercising my non-fiction reading muscles of late. I'm trying weaponise it as an antidote to AI slop and doom-scrolling. My last read was Designing Data-Intensive Applications by Martin Klepmann (the newly released second edition), it was a wonderful read!