Live data from Hacker News

As AI eats the web, the internet’s collective memory is disappearing

thewalrus.ca

201–210 of 1001 posts

Re: As AI eats the web, the internet’s collective memory is disappearing

#201
post #153

Funny, I was just thinking this morning that Google searches are absolutely horrible these days. It's like it has amnesia, a lot of recent history seems to be just gone. Especially on non US specific sites too.

Kagi

Kagi can’t solve the fact that the internet itself has gone to shit. The independent forums are largely gone, the mainstream social media’s have all locked down and been spammed with AI slop.

Re: As AI eats the web, the internet’s collective memory is disappearing

#202
post #196

AI will kill the internet because it is killing the incentive to make it. It is an industrial-strength example of why we don’t allow stealing.

> why we don’t allow stealing.

With the not-so-minor qualification that the biggest thieves have always gotten away scot-free. AI is just the international whole-internet version of this.

Re: As AI eats the web, the internet’s collective memory is disappearing

#203
post #173
post #153

Funny, I was just thinking this morning that Google searches are absolutely horrible these days. It's like it has amnesia, a lot of recent history seems to be just gone. Especially on non US specific sites too.

The Internet has been shrinking massively. My earliest experiences with the Internet were discovering the world of hobby OS dev around the turn of the millennium, when I chanced upon someone’s personal website talking about their OS, with source code and screenshots and dedicated forum. My mind was blown. I spent two years finding hundreds of small websites dedicated to the topic, hung out on IRC communities with oth…

Checkout Kagi SmallWeb !

Re: As AI eats the web, the internet’s collective memory is disappearing

#205

Earlier quoted context omitted.

I've seen websites put up some draconian measures to try and get a grip on the scraping. So much for the sub-second loading experience when you have Cloudflare, Google, Anubis, and all these other captcha services trying to see if you're a human. It's made the web browsing experience so much worse. Some of the proposals to address this include charging bots for access to web resources, but they will also have repercu…

Cloudflare specifically has a block for LLM and AI training bots now. Not sure of the effectiveness but it's there.

It still only blocks "well-behaved" bots that have proper User-Agents and respect robots.txt, so it's largely pointless.

The problematic bots are all disguising themselves as Chrome and sending requests from millions of residential proxy IPs, and the only real solution to those is some sort of captcha or PoW page on first visit.

Re: As AI eats the web, the internet’s collective memory is disappearing

#206
post #167
post #161

Earlier quoted context omitted.

They're so horrible that I've started defaulting to their AI summaries. And I hate those summaries. It's just that the regular results are so terrible now, and seemingly getting worse at a noticeable pace. I used to not worry. I was sure that a competitor would come along and fix search. But the longer that's not happening, the more nervous I'm getting that we'll actually lose search. If a few more years pass in the…

Unsurprisingly all search engines seem to be struggling with AI content sites as well. It's rare to get human articles, sometimes rare to even get authorative websites. It's frequently a bot site with a plausible enough name like, potterspainterly.com or medhealthdirect or something with oddly specific articles written in the last year.

This is the root problem. The idea that Google is deliberately sabotaging search seems far less likely than the idea that the internet is mostly garbage and SEO slop.

Re: As AI eats the web, the internet’s collective memory is disappearing

#207
post #173

Earlier quoted context omitted.

The Internet has been shrinking massively. My earliest experiences with the Internet were discovering the world of hobby OS dev around the turn of the millennium, when I chanced upon someone’s personal website talking about their OS, with source code and screenshots and dedicated forum. My mind was blown. I spent two years finding hundreds of small websites dedicated to the topic, hung out on IRC communities with oth…

On a whim I watched my favorite childhood movie last week, Hackers. It's goofy in some ways, but man it captures the "wild west" feeling of early and mid 90's internet. It was just you, a slow connection to anywhere, and open ports all over the place. Right after I watched it, I dusted off an old hub, connected a few external usb-to-ethernet adapters to my work PC VM's, and now run them through an OpenBSD packet filt…

"Let's echo 23, see what's up"

Re: As AI eats the web, the internet’s collective memory is disappearing

#208
The concept of an almanac seems relevant again: a yearly printed book with verified, accurate information. No manipulation at a later date, no AI hallucinations, etc.

The most famous one was probably Benjamin Franklin’s:

https://en.wikipedia.org/wiki/Poor_Richard%27s_Almanack

Paper encyclopedias might make a comeback for the same reason.

Re: As AI eats the web, the internet’s collective memory is disappearing

#209
post #161
post #153

Funny, I was just thinking this morning that Google searches are absolutely horrible these days. It's like it has amnesia, a lot of recent history seems to be just gone. Especially on non US specific sites too.

They're so horrible that I've started defaulting to their AI summaries. And I hate those summaries. It's just that the regular results are so terrible now, and seemingly getting worse at a noticeable pace. I used to not worry. I was sure that a competitor would come along and fix search. But the longer that's not happening, the more nervous I'm getting that we'll actually lose search. If a few more years pass in the…

That's certainly the goal, to drive more users to AI by making the other option worse. The real question is when do you put a stop to it. When brain implants are 2x as productive are you going to say nah? It's times like these were you are supposed to take a step back and consider what you are actually producing and why.

Re: As AI eats the web, the internet’s collective memory is disappearing

#210
post #167

Earlier quoted context omitted.

Unsurprisingly all search engines seem to be struggling with AI content sites as well. It's rare to get human articles, sometimes rare to even get authorative websites. It's frequently a bot site with a plausible enough name like, potterspainterly.com or medhealthdirect or something with oddly specific articles written in the last year.

This is the root problem. The idea that Google is deliberately sabotaging search seems far less likely than the idea that the internet is mostly garbage and SEO slop.

perhaps this would not be a problem if google did not directly monetize AI Slop... for that matter why even include AI crap in search.
Post reply on HN