Live data from Hacker News

Why are anime catgirls blocking my access to the Linux kernel?

lock.cmpxchg8b.com

431–440 of 968 posts

Re: Why are anime catgirls blocking my access to the Linux kernel?

#431

Earlier quoted context omitted.

I feel like the future will have this, plus ads displayed while the work is done, so websites can profit while they profit.

Every now and then I consider stepping away from the computer job, and becoming a lumberjack. This is one of those moments.

Worth getting to know the in and outs of forest management now. I don’t think AI will take most tech jobs soon, but they sure as hell are already making them boring.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#432
post #130

Earlier quoted context omitted.

> as AI scrapers bother implementing the PoW That's what it's for, isn't it? Make crawling slower and more expensive. Shitty crawlers not being able to run the PoW efficiently or at all is just a plus. Although: > which is trivial for them, as the post explains Sadly the site's being hugged to death right now so I can't really tell if I'm missing part of your argument here. > figure out that they can simply remove "M…

The explanation of how the estimate is made is more detailed, but here is the referenced conclusion: >> So (11508 websites * 2^16 sha256 operations) / 2^21, that’s about 6 minutes to mine enough tokens for every single Anubis deployment in the world. That means the cost of unrestricted crawler access to the internet for a week is approximately $0. >> In fact, I don’t think we reach a single cent per month in compute…

If you use one solution to browse the entire site, you're linking every pageload to the same session, and can then be easily singled out and blocked. The idea that you can scan a site for a week by solving the riddle once is incorrect. That works for non-abusers.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#433
post #273

Earlier quoted context omitted.

... looks like they did: https://github.com/TecharoHQ/anubis/pull/1004 , timestamped a few hours after your comment.

lmfao so that kinda defeats the entire point of this project if they have to resort to a manual IP blocklist anyways

I would actually say that it's been successful in determining at least one, so far, large scale abuser, which can the be blocked via more traditional methods.

I have my own project that finds malicious traffic IP addresses, and through searching through the results, it's allowed me to identify IP address ranges to be blocked completely.

Yielding useful information may not have been what it was designed to do, but it's still a useful outcome. Funny thing about Anubis' viral popularity is that it was designed to just protect the author's personal site from a vast army of resource-sucking marauders, and grew because it was open sourced and a LOT of other people found it useful and effective.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#434

Earlier quoted context omitted.

That's a matter of increasing the difficulty isn't it? And if the added cost is really negligible, we can just switch to a "refresh" challenge for the same added latency and without burning energy for no reason.

I am guessing you don't realize that that means people using not the latest generation phones will suffer.

I'm not using the latest generation of phones, not in the slightest, and I don't really care, because the alternative to Anubis-like intersitials is the sites not loading at all when they're mass-crawled to death.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#435

This is a usually technical crowd, so I can't help but wonder if many people genuinely don't get it, or if they are just feigning a lack of understanding to be dismissive of Anubis. Sure, the people who make the AI scraper bots are going to figure out how to actually do the work. The point is that they hadn't, and this worked for quite a while. As the botmakers circumvent, new methods of proof-of-notbot will be made…

> The point is that they hadn't, and this worked for quite a while.

That's what I was hoping to get from the "Numbers" section.

I generally don't look up the logs or numbers on my tiny, personal web spaces hosted on my server, and I imagine I could, at some point, become the victim of aggressive crawling (or maybe I have without noticing because I've got an oversized server on a dual link connection).

But the numbers actually only show the performance of doing the PoW, not the effect it has had on any site — I am just curious, and I'd love it if someone has done the analysis, ideally grouped by the bot type ("OpenAI bot was responsible for 17% of all requests, this got reduced from 900k requests a day to 0 a day"...). Search, unfortunately, only gives me all the "Anubis is helping fight aggressive crawling" blog articles, nothing with substance (I haven't tried hard, I admit).

Edit: from further down the thread there's https://dukespace.lib.duke.edu/server/api/core/bitstreams/81... but no analysis of how many real customers were denied — more data would be even better

Re: Why are anime catgirls blocking my access to the Linux kernel?

#436
post #379

Earlier quoted context omitted.

It really should be recognised just how many people are watching Cloudflare interstitials on nearly every site these days (and I totally get why this happens) yet making a huge amount of noise about Anubis on a very small amount of sites.

I don't trip over CloudFlare except when in a weird VPN, and then it always gets out of my way after the challenge. Anubis screws with me a lot, and often doesn't work.

It's the other way around for me sometimes — I've never had issue with Anubis, I frequently get it with CF-protected sites.

(Not to mention all the sites which started putting country restrictions in on their generally useful instruction articles etc — argh)

Re: Why are anime catgirls blocking my access to the Linux kernel?

#437
post #274

Earlier quoted context omitted.

I'll set mine to "null" if the rest of you will set yours...

The string “null” or actually null? I have recently seen a huge amount of bot traffic which has actually no UA and just outright block it. It’s almost entirely (microsoft cloud) Azure script attacks.

I was thinking the string "null". But if you have a better idea.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#438

This is a usually technical crowd, so I can't help but wonder if many people genuinely don't get it, or if they are just feigning a lack of understanding to be dismissive of Anubis. Sure, the people who make the AI scraper bots are going to figure out how to actually do the work. The point is that they hadn't, and this worked for quite a while. As the botmakers circumvent, new methods of proof-of-notbot will be made…

> This is a usually technical crowd, so I can't help but wonder if many people genuinely don't get it, or if they are just feigning a lack of understanding to be dismissive of Anubis. This is a confusing comment because it appears you don’t understand the well-written critique in the linked blog post. > This is like those simple things on submission forms that ask you what 7 + 2 is. Of course everyone knows that a cr…

But for actual live users who don't see anything but a transient screen, Anubis is a better experience than all those pesky CAPTCHAs (I am bored of trying to recognize bikes, pedestrian crossings, buses, hydrants).

The question is if this is the sweet spot, and I can't find anyone doing the comparative study (how many annoyed human visitors, how many humans stopped and, obviously, how many bots stopped).

Re: Why are anime catgirls blocking my access to the Linux kernel?

#439

Earlier quoted context omitted.

That's a matter of increasing the difficulty isn't it? And if the added cost is really negligible, we can just switch to a "refresh" challenge for the same added latency and without burning energy for no reason.

If you increase the difficulty much beyond what it currently is, legitimate users end up having to wait for ages.

And if you don't increase it, crawlers will DoS the sites again and legitimate users will have to wait until the next tech hype bubble for the site to load, which is the reason why software like Anubis is being installed in the first place.

Re: Why are anime catgirls blocking my access to the Linux kernel?

#440

Earlier quoted context omitted.

It doesn't need to. Thanks to asymmetric cryptography governments can in theory provide you with a way to prove you are a human (or of a certain age) without: 1. the government knowing who you are authenticating yourself to 2. or the recipient learning anything but the fact that you are a human 3. or the recipient being able to link you to a previous session if you authenticate yourself again later The EU is trying t…

Such schemes have the fatal flaw that they can be trivially abused. All you need are a couple of stolen/sold identities and bots start proving their humanness and adultness to everyone.

Blatant automatic behavior can still be detected, and much more definitive actions can be takes in such a system
Post reply on HN