Live data from Hacker News

As AI eats the web, the internet’s collective memory is disappearing

thewalrus.ca

661–670 of 977 posts

Re: As AI eats the web, the internet’s collective memory is disappearing

#661

Earlier quoted context omitted.

It is an astute point. I agree that we have largely lost a lot of our shared reality. But as with any "beginning" of a long, diffuse process, people might quibble about the specifics. I offer a few other moments you might gesture toward as the beginning of the end of shared reality. First, 1987, with the elimination of the Fairness Doctrine and the subsequent boom in partisan talk radio shows. Second, 1989, when cabl…

Yes, there's certainly less of a monoculture now that people have greater choice in what media they consume. Personally I have trouble seeing that as a bad thing. Greater diversity of taste, culture, and opinion makes for a richer, more interesting society in my opinion. Though I recognize it does have downsides. I wonder if there's a way to keep the positive effects of such diversity but mitigate the drawbacks. Cert…

> I wonder if there's a way to keep the positive effects of such diversity but mitigate the drawbacks

The answer society mostly settled on is representative democracy.

You appoint qualified candidates via consensus, and then give them the microphone and some measure of control as long as the consensus stays strong. This is sort of what we have now with influencer culture.

The flaw has always been human nature. It turns out that half of all people are of below average intelligence and they consequently make bad decisions. Especially if the smarter half use them as pawns to assume control, which is what US politics has become.

Once the Morlocks and the Eloi have settled into their roles the entire thing falls apart and democracy dies screaming.

Re: As AI eats the web, the internet’s collective memory is disappearing

#663
post #14

I feel like collecting, curating, and protecting high quality corpuses of "truth" is going to become increasingly important for high quality AI. There will come a day (and probably soon) when "training on the public internet" (Reddit, etc) will taint your model with metric tons of corporate contamination, political poison, and other adversarial content intentionally crafted to bias AIs for various reasons (corporate…

This already exists, there are archives of Reddit or other sites, and Anna's Archive for papers and books.

I think OP is more concerned with we are going to ensure that new data added to the "trusted corpus" is going to be free of LLM taint.

Re: As AI eats the web, the internet’s collective memory is disappearing

#664
post #5

I occasionally use Google Search when DuckDuckGo fails to give me relevant. Almost always, Google has better results. Though I can find its AI answers annoying aggressive. I'll look up like two search terms and the AI will bullshit multiple paragraphs out of despite having zero context of what I am looking for. DuckDuckGo seems to have detection of whether it should give an AI answer. And it allows you to have more g…

I've used DDG for years (thousands of searches) and when I switch back to Google thinking I might be missing something... I'm always let down. Seriously, the results are pathetically bad now and have been for years.

Re: As AI eats the web, the internet’s collective memory is disappearing

#665
post #173

Earlier quoted context omitted.

The Internet has been shrinking massively. My earliest experiences with the Internet were discovering the world of hobby OS dev around the turn of the millennium, when I chanced upon someone’s personal website talking about their OS, with source code and screenshots and dedicated forum. My mind was blown. I spent two years finding hundreds of small websites dedicated to the topic, hung out on IRC communities with oth…

Most hobby communities in my spheres of interest have been subsumed into Discord. It is yet another silo, but it does feel lively. I don't think I'm contradicting you here, I just feel less negatively about it.

I don't think I've ever tried Discord. Is it like IRC? Or more like a forum

Re: As AI eats the web, the internet’s collective memory is disappearing

#666

My sister, a journalist, mentioned to me that she only uses google search because she had learned how to get information typically only Google indexed in the country she lives in, in a way it was not exposed on chat bots. She often has to search for information like Old govt forms released as public record with a fixed a certain format photo scanned into a pdf and indexed by Google were often on the second page of th…

This is a conundrum I always found interesting. If you know how to use a search engine (i.e. knowing how to use operators and structure a search query), you're almost always able to find what you're looking for very quickly, and in most cases (well, before SEO), the results are high-quality. You'll spend the same amount of time trying to fact-check an LLM (since you'll likely skim the articles it used in generating its response _which you would have done anyway if you used the search engine directly_).

I actually took a (required) class in middle school that taught us how to use a library. Amongst other things, the librarian taught us how to use Google effectively. Everything I learned then (this was in the early 2000s) still works today, since the process of using a search engine hasn't changed very much since its inception.

So many people never learned (or never cared about learning) how to use a search engine, thus why we're here today.

Re: As AI eats the web, the internet’s collective memory is disappearing

#667
post #405

Earlier quoted context omitted.

Yeah, having kids is tough call. I was reminded of a tactic used by life insurance companies, which are more successful when they show a client a photo of themselves at age 70. I pictured myself sitting there alone, lonely, perhaps without a wife by then (a 50/50 chance). And would I be calling friends my own age? Or my kids? Although the likelihood that I won’t get along with them as an adult… you never know; anothe…

Our DNA was largely coded by prior generations that didn't really have a choice of reproduction, it just kind of happened because it's a natural result of sex. That connection has been severed in modern civilization. It's going to take a while for our DNA to adapt.

10,000 years is too long for me ;)

Re: As AI eats the web, the internet’s collective memory is disappearing

#668

My sister, a journalist, mentioned to me that she only uses google search because she had learned how to get information typically only Google indexed in the country she lives in, in a way it was not exposed on chat bots. She often has to search for information like Old govt forms released as public record with a fixed a certain format photo scanned into a pdf and indexed by Google were often on the second page of th…

Would be interesting to know if those same long tail results come up in Alt-Power [0], which also uses Google's index. So far I get what I ask for, but would be reassuring to know the whole long tail index is indeed shared and I'm not missing relevant results.

[0]: https://altpower.app

Re: As AI eats the web, the internet’s collective memory is disappearing

#669
post #341

AI has killed reading-anything-written-after-AI for me. Due to this effect it is probably the worst invention in human history or pre-history.

I was just thinking yesterday that it might actually be worse than nuclear weapons. Both in terms of likelihood to destroy all of humanity and in terms of “how did nobody working on this see that this was an obviously horrifying idea”

Re: As AI eats the web, the internet’s collective memory is disappearing

#670

Earlier quoted context omitted.

What even is a “shared reality”? For example my mum and I could watch the exact same movie and showing at the cinema and still come away with a completely different opinion of it. And even when TV was limited to a small few national OTA (over the air) channels, different people would tune in at different times to watch their different preference of shows. So just because content was fewer, it didn’t necessarily equat…

> What even is a “shared reality”? For example my mum and I could watch the exact same movie and showing at the cinema and still come away with a completely different opinion of it. A: It excludes opinion.

Everything is opinion. A shared reality is just where opinions coincide.
Post reply on HN