Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI companies cause most of traffic on forums

pod.geraspora.de

Post reply on HN
Print view View original

341–350 of 466 posts

Re: AI companies cause most of traffic on forums

#341

Post by alphan0n »

denschub wrote: post #290
alphan0n wrote: post #289

Earlier quoted context omitted.

What about the CommonCrawl archives? That clearly show the same robots.txt that allows all, from September through December? You’re a phony.

Here's something for the next time you want to "expose" a phony: before linking me to your investigative source, ask for exact date-stamps when I made changes to the robots.txt and what I did, as well as when I blocked IPs. I could have told you those exactly, because all those changes are tracked in a git repo. If you asked me first, I could have answered you with the precise dates, and you would have realized that…

>I'm not an idiot and I know when commoncrawl crawls

When will commoncrawl crawl your site again?

Re: AI companies cause most of traffic on forums

#342

Post by maximinus_thrax »

stackghost wrote: post #206
franga2000 wrote: post #126

Earlier quoted context omitted.

If I make a physical robot and it runs someone over, I'm still liable, even though it was a delivery robot, not a running over people robot. If a bot sends so many requests that a site completely collapses, the owner is liable, even though it was a scraping bot and not a denial of service bot.

The law doesn't work by analogy.

Except when it does https://en.wikipedia.org/wiki/Analogy_(law)

Re: AI companies cause most of traffic on forums

#343

Post by _zagj »

Ukv wrote: post #9

Are these IPs actually from OpenAI/etc. ( https://openai.com/gptbot.json ), or is it possibly something else masquerading as these bots? The real GPTBot/Amazonbot/etc. claim to obey robots.txt, and switching to a non-bot UA string seems extra questionable behaviour.

I don't trust OpenAI, and I don't know why anyone else would at this point.

Re: AI companies cause most of traffic on forums

#344

Post by nkrisc »

alphan0n wrote: post #335
mplewis wrote: post #330

Earlier quoted context omitted.

What is causing you to be so unnecessarily aggressive?

Liars should be called out, necessarily. Intellectual dishonesty is cancer. I could be more aggressive if it were something that really mattered.

Lying requires intent to deceive. How have you determined their intent?

Re: AI companies cause most of traffic on forums

#345

Post by [deleted] »

ls612 wrote: post #324
kmeisthax wrote: post #322

Earlier quoted context omitted.

This is already a thing for basically all of the second[0] and third worlds. A non-trivial amount of Cloudflare's security value is plausible algorithmic discrimination and collective punishment as a service. [0] Previously Soviet-aligned countries; i.e. Russia and eastern Europe.

People hate collective punishment because it works so well.

[deleted]

Re: AI companies cause most of traffic on forums

#346

Post by forgetfreeman »

panic wrote: post #334
ls612 wrote: post #324

Earlier quoted context omitted.

People hate collective punishment because it works so well.

Works how? Are these blocks leading to progress toward solving any of the underlying issues?

It's unclear that there are actors below the regional-conglomerate-of-nation-states level that could credibly resolve the underlying issues, and given legislation and enforcement regimes sterling track record of resolving technological problems realistically it seems questionable that solutions could exist in practice. Anyway this kind of stuff is well outside the bounds of what a single org hosting an online forum could credibly address. Pragmatism uber alles.

Re: AI companies cause most of traffic on forums

#347

Post by anonym29 »

ls612 wrote: post #324
kmeisthax wrote: post #322

Earlier quoted context omitted.

This is already a thing for basically all of the second[0] and third worlds. A non-trivial amount of Cloudflare's security value is plausible algorithmic discrimination and collective punishment as a service. [0] Previously Soviet-aligned countries; i.e. Russia and eastern Europe.

People hate collective punishment because it works so well.

Innocent people hate being punished for the behavior of other people, whom the innocent people have no control over.*

FTFY.

Re: AI companies cause most of traffic on forums

#348

Post by shark_laser »

kmeisthax wrote: post #322
MetaWhirledPeas wrote: post #114

Earlier quoted context omitted.

> Cloudflare also has a feature to block known AI bots and even suspected AI bots In addition to other crushing internet risks, add wrongly blacklisted as a bot to the list.

This is already a thing for basically all of the second[0] and third worlds. A non-trivial amount of Cloudflare's security value is plausible algorithmic discrimination and collective punishment as a service. [0] Previously Soviet-aligned countries; i.e. Russia and eastern Europe.

Yep. Same for most of Asia too.

Cloudflare's filters are basically straight up racist.

I have stopped using so many sites due to their use of Cloudflare.

Re: AI companies cause most of traffic on forums

#349

Post by n144q »

nkrisc wrote: post #344
alphan0n wrote: post #335

Earlier quoted context omitted.

Liars should be called out, necessarily. Intellectual dishonesty is cancer. I could be more aggressive if it were something that really mattered.

Lying requires intent to deceive. How have you determined their intent?

> Lying requires intent to deceive

Since when do we ask people to guess other people's intent when they have better things to show, which is called evidence?

Surely we should talk about things with substantiated matter?

Re: AI companies cause most of traffic on forums

#350

Post by saagarjha »

ls612 wrote: post #324
kmeisthax wrote: post #322

Earlier quoted context omitted.

This is already a thing for basically all of the second[0] and third worlds. A non-trivial amount of Cloudflare's security value is plausible algorithmic discrimination and collective punishment as a service. [0] Previously Soviet-aligned countries; i.e. Russia and eastern Europe.

People hate collective punishment because it works so well.

Putting everyone in jail also works well to prevent crime.
Post reply on HN