Live data from Hacker News

AI companies cause most of traffic on forums

pod.geraspora.de

461–466 of 466 posts

Re: AI companies cause most of traffic on forums

#463
post #149
post #56

Their appetite cannot be quenched, and there is little to no value in giving them access to the content. I have data... 7d from a single platform with about 30 forums on this instance. 4.8M hits from Claude 390k from Amazon 261k from Data For SEO 148k from Chat GPT That Claude one! Wowser. Bots that match this (which is also the list I block on some other forums that are fully private by default): (?i). (AhrefsBot|AI…

You just plain blocking anyone using node from programatically accessing your content with Axios?

Why not?

Re: AI companies cause most of traffic on forums

#464

Earlier quoted context omitted.

This is already a thing for basically all of the second[0] and third worlds. A non-trivial amount of Cloudflare's security value is plausible algorithmic discrimination and collective punishment as a service. [0] Previously Soviet-aligned countries; i.e. Russia and eastern Europe.

I have a growing Mastodon thread of this shit: https://mastodon.social/@grishka/111934602844613193 It's of course trivially bypassable with a VPN, but getting a 403 for an innocent get request of a public resource makes me angry every time nonetheless.

Exactly. I have to use a VPN just for this kind of bu**it. :/

Re: AI companies cause most of traffic on forums

#465

Earlier quoted context omitted.

> Cloudflare also has a feature to block known AI bots and even suspected AI bots In addition to other crushing internet risks, add wrongly blacklisted as a bot to the list.

We’re rapidly approaching a login-only internet. If you’re not logged in with google on chrome then no website for you! Attestation/wei enable this

And not just a login but soon probably also the real verified identity tied to it. The internet is becoming a worse place than the real world.
Post reply on HN