Live data from Hacker News

Creepy Crawlies

people.kernel.org

721–724 of 724 posts

Re: Creepy Crawlies

#721

So, you'd think that something that pretends to be “Artificial Intelligence” would use the most efficient way of using our data for training purposes, right? I'm strongly convinced that these aren't "AI crawlers"; they're just plain DDoSes done by those who have interests in turning the Internet into a dystopian walled garden with "security", and now they have a convenient scapegoat to blame. Don't you find it too co…

The questions the LLMs can't solve puts you in a cat and mouse game. They sure can solve most of those with the correct tooling, and i would argue its easier to create this tooling than it is to keep innovating with new questions LLMs cannot answer

This is already a "cat and mouse game", but one that conveniently benefits both the browser monopoly and the authoritarians wanting to turn the Internet into a closed proprietary system.

...and how convenient that pointing out the inconsistencies and this massive scheme of propaganda and manufactured consent gets you downvoted. "Truth does not resist questioning."

Re: Creepy Crawlies

#722

I have the feeling that the hate might be misplaced. For a shopping website or user generated content website, I might understand the terrible load of crawlers that are trying to "steal" the data. But for the kernel, what's the purpose? Are you that "no human" are seeing your page or its content? Maybe we should investigate more the usage being this "bots". I don't buy the explanation that there are millions LLM that…

Of course it is. I don't even think this has anything to do with AI. You're experiencing how vulnerable the masses are to propaganda and manufactured consent.

Re: Creepy Crawlies

#723

Earlier quoted context omitted.

wouldn't that just make your connection load worse?

Currently not really an issue on this site but connections aren't an issue on Elixir usually anyway, unless you get up to about 1 million on one machine IIRC.

normally depends on the type of traffic you are serving, but that seems like a weird thing to say as a blanket statement.

Re: Creepy Crawlies

#724
instead of making the bots solve captchas, that is an infinite mouse-cat game, couldnt we accept bitcoin payments from the crawlers? it would be programmable, always cryptographically verifiable access for a single crawler. i read from moltbook some of these agents already have a wallet attached to them, so in my opinion it would sound more sensible to make them pay instead of slowing them down.

also some commenters suggested to make the agents mine the coins but with my limited bitcoin knowledge that would take more time that would be suitable for the crawlers to access the commits.

Post reply on HN