Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Why are anime catgirls blocking my access to the Linux kernel?

lock.cmpxchg8b.com

Post reply on HN
Print view View original

91–100 of 968 posts

Re: Why are anime catgirls blocking my access to the Linux kernel?

#91

Post by Imustaskforhelp »

kingstnap wrote: post #44
iefbr14 wrote: post #26

I wouldn't be surprised if just delaying the server response by some 3 seconds will have the same effect on those scrapers as Anubis claims.

There is literally no point wasting 3 seconds of a computer's time and it's expensive wasting 3 seconds of a person's time. That is literally an anti-human filter.

From tjhorner on this same thread

"Anubis doesn't target crawlers which run JS (or those which use a headless browser, etc.) It's meant to block the low-effort crawlers that tend to make up large swaths of spam traffic. One can argue about the efficacy of this approach, but those higher-effort crawlers are out of scope for the project."

So its meant/preferred to block low effort crawlers which can still cause damage if you don't deal with them. a 3 second deterrent seems good in that regard. Maybe the 3 second deterrent can come as in rate limiting an ip? but they might use swath's of ip :/

Re: Why are anime catgirls blocking my access to the Linux kernel?

#92

Post by zahlman »

Arnavion wrote: post #45

>This dance to get access is just a minor annoyance for me, but I question how it proves I’m not a bot. These steps can be trivially and cheaply automated. >I think the end result is just an internet resource I need is a little harder to access, and we have to waste a small amount of energy. No need to mimic the actual challenge process. Just change your user agent to not have "Mozilla" in it; Anubis only serves you…

> Just change your user agent to not have "Mozilla" in it. Anubis only serves you the challenge if you have that.

Won't that break many other things? My understanding was that basically everyone's user-agent string nowadays is packed with a full suite of standard lies.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#93

Post by sugarpimpdorsey »

Every time I see one of these I think it's a malicious redirect to some pervert-dwelling imageboard.

On that note, is kernel.org really using this for free and not the paid version without the anime? Linux Foundation really that desperate for cash after they gas up all the BMW's?

Re: Why are anime catgirls blocking my access to the Linux kernel?

#94

Post by qualeed »

tptacek wrote: post #78
xena wrote: post #32

[dead]

You needed to have a security contact on your website, or at least in the repo. You did not. You assumed security researchers would instead back out to your Github account's repository list, find the .github repository, and look for a security policy there. That's not a thing! I'm really surprised you wrote this.

>I'm really surprised you wrote this.

I agree with the rest of your comment, but this seems like a weird little jab to add on for no particular reason. Am I misinterpreting?

Re: Why are anime catgirls blocking my access to the Linux kernel?

#95

Post by zahlman »

Philpax wrote: post #21
jimmaswell wrote: post #12

What exactly is so bad about AI crawlers compared to Google or Bing? Is there more volume or is it just "I don't like AI"?

Volume, primarily - the scrapers are running full-tilt, which many dynamic websites aren't designed to handle: https://pod.geraspora.de/posts/17342163

Why not just actually rate-limit everyone, instead of slowing them down with proof-of-work?

Re: Why are anime catgirls blocking my access to the Linux kernel?

#96

Post by Imustaskforhelp »

jerf wrote: post #83
johnea wrote: post #50

My biggest bitch is that it requires JS and cookies... Although the long term problem is the business model of servers paying for all network bandwidth. Actual human users have consumed a minority of total net bandwidth for decades: https://www.atom.com/blog/internet-statistics/ Part 4 shows bots out using humans in 1996 8-/ What are "bots"? This needs to include goggleadservices, PIA sharing for profit, real-time ad…

"Although the long term problem is the business model of servers paying for all network bandwidth." Servers do not "pay for all the network bandwidth" as if they are somehow being targeted for fees and carrying water for the clients that are somehow getting it for "free". Everyone pays for the bandwidth they use, clients, servers, and all the networks in between, one way or another. Nobody out there gets free bandwid…

The Ai scrapers are most likely vc funded and all they care about is getting as much data as possible and not worry about the costs.

They are hiring machines at scale too so definitely bandwidth etc. are cheaper for them too. Maybe use a provider that doesn't have too much bandwidth issues (hetzner?)

But still, the point being that you might be hosting website on your small server and that scraper with its machines beast can come and effectively ddos your server looking for data to scrape. Deterring them is what matters so that the economical scale finally slide back to our favours again.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#97

Post by Arnavion »

zahlman wrote: post #92
Arnavion wrote: post #45

>This dance to get access is just a minor annoyance for me, but I question how it proves I’m not a bot. These steps can be trivially and cheaply automated. >I think the end result is just an internet resource I need is a little harder to access, and we have to waste a small amount of energy. No need to mimic the actual challenge process. Just change your user agent to not have "Mozilla" in it; Anubis only serves you…

> Just change your user agent to not have "Mozilla" in it. Anubis only serves you the challenge if you have that. Won't that break many other things? My understanding was that basically everyone's user-agent string nowadays is packed with a full suite of standard lies.

It doesn't break the two kernel.org domains that the article is about, nor any of the others I use. At least not in a way that I noticed.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#98

Post by qualeed »

sugarpimpdorsey wrote: post #93

Every time I see one of these I think it's a malicious redirect to some pervert-dwelling imageboard. On that note, is kernel.org really using this for free and not the paid version without the anime? Linux Foundation really that desperate for cash after they gas up all the BMW's?

It's crazy (especially considering anime is more popular now than ever; netflix alone is making billions a year on anime) that people see a completely innocent little anime picture and immediately think "pervent-dwelling imageboard".

Re: Why are anime catgirls blocking my access to the Linux kernel?

#99

Post by tptacek »

qualeed wrote: post #94
tptacek wrote: post #78

Earlier quoted context omitted.

You needed to have a security contact on your website, or at least in the repo. You did not. You assumed security researchers would instead back out to your Github account's repository list, find the .github repository, and look for a security policy there. That's not a thing! I'm really surprised you wrote this.

> I'm really surprised you wrote this. I agree with the rest of your comment, but this seems like a weird little jab to add on for no particular reason. Am I misinterpreting?

No, there's some background context I'm not sharing, but it's not interesting. I didn't mean to be cryptic, but, obviously, I managed to be cryptic. I promise you're not missing anything.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#100

Post by Seattle3503 »

qualeed wrote: post #98
sugarpimpdorsey wrote: post #93

Every time I see one of these I think it's a malicious redirect to some pervert-dwelling imageboard. On that note, is kernel.org really using this for free and not the paid version without the anime? Linux Foundation really that desperate for cash after they gas up all the BMW's?

It's crazy ( especially considering anime is more popular now than ever; netflix alone is making billions a year on anime) that people see a completely innocent little anime picture and immediately think "pervent-dwelling imageboard".

To be fair, that's the sort of place where I spend most of my free time.
Post reply on HN