Live data from Hacker News

Cloudflare is turning off the internet for me

blog.dijit.sh

271–280 of 335 posts

Re: Cloudflare is turning off the internet for me

#271
post #83

It appears that you may have made some modifications to your user agent string. If you revert your user agent to the one provided by default by your browser vendor everything will be fine.

Why is it that something as malleable as a user-agent string trips these kinds of sensors? If I were to write a bot, copying current browsers' user-agents is literally the first thing I'd do

Speaking from experience: there are a ton of bots that don't set UA and use whatever their request library sets.

Re: Cloudflare is turning off the internet for me

#272
post #262

Earlier quoted context omitted.

> Let's hear some real solutions. It's by no means a full solution (there likely is no single full solution), and it may even be a bad solution -- but lately I've been trying to think about what the Internet would look like if we didn't have a massive arbitrage potential around server requests. Part of the reason why everyone is trying to detect bots is because bots will very, very rapidly eat up your bandwidth and C…

> Part of the reason why everyone is trying to detect bots is because bots will very, very rapidly eat up your bandwidth and CPU time. It is? Thought bot detection was only done during registration etc. to stop them from sending spam etc. to real users. If anything the javascript world we live in helps combat this. You need insane resources on the client just to have a page open. Several orders of magnitude more than…

In that case, an IP or IP block throttling is good enough.

Except then there are those pesky CGNATs to handle including Chinese Great Wall.

Anyway, high profile spammers will emulate enough of the browser to render any measure based on browser anomaly detection worthless. Including using a headless browser. The only way to defeat them would be too put some quite computationally intensive JS operation... (On par with mining, ruining all the laptops, phones and tablets. But you can make it not trigger every time.) This would make spamming expensive.

Server-side we have excellent AI spam filters that nobody seems to be using to fire off a captcha check later. The big problem here is that you cannot offload to some provider without inviting big privacy concerns. (Same problem as forum/chat/discussion platform providers.)

Re: Cloudflare is turning off the internet for me

#273
post #17

The problem presented by services like ReCaptcha and Cloudflare is a tough nut to crack. They're silently embedded in a huge portion of modern websites, and the average user will never even know about them. But it seems to be way too easy for them to blanket-ban or serve an absurd amount of captchas to powerusers, linux gurus, privacy geeks, or anyone with the wrong combination of browser+addons. And the failures (as…

I think the long term solution could be in making the network providers and ISPs more responsible for the malicious traffic originating from their networks.

For example the botnet traffic is best stopped at the origin. If there was some pressure for the service providers, I'm fairly sure they could do more to detect subscriptions with compromised devices and take appropriate actions. Actions can include educating the users and if necessary, blocking the subscription until problems are fixed.

While this certainly would not immediately cover the whole world, it would be a start. On the website level you could then treat traffic from networks that have agreed to cut malicious traffic in different way.

Re: Cloudflare is turning off the internet for me

#274
post #83

It appears that you may have made some modifications to your user agent string. If you revert your user agent to the one provided by default by your browser vendor everything will be fine.

At least now people can see why Google want to deprecate the User-Agent string.

Re: Cloudflare is turning off the internet for me

#275

Earlier quoted context omitted.

> Let's hear some real solutions. It's by no means a full solution (there likely is no single full solution), and it may even be a bad solution -- but lately I've been trying to think about what the Internet would look like if we didn't have a massive arbitrage potential around server requests. Part of the reason why everyone is trying to detect bots is because bots will very, very rapidly eat up your bandwidth and C…

> automatically increase the prices of requests by a fraction of a cent to compensate Great concept. CPU, bandwidth, electricity, it's all just energy. And to a significant degree, money is just energy stored. I generate energy with my own work, store it in the form of money, and then transfer that energy to someone else, maybe to heat my home or cook me a meal. Before money, I had to barter for those things. Maybe c…

> Before money, I had to barter for those things

Not at all. Barter was quite uncommon also unpractical. Most societies used (and use) social connections and trust.

Re: Cloudflare is turning off the internet for me

#276

Earlier quoted context omitted.

The problem is that the narrative has been poisoned by Cloudflare and Google (for Recaptcha) - they both overstate the size of the problem, as well as the effectiveness of their solution. In other words: when someone demands "real solutions", they're typically expecting a degree of solution that quite likely just does not exist at all, to solve a problem that isn't as severe as people believe, just because that's the…

I think you're confusing what you wish was true with what is actually true. For instance, here was a post from a few weeks ago about how one annoyed user was able to take down a Mastodon instance until the admin gave up and put it behind CF: https://news.ycombinator.com/item?id=21719793 . Bear in mind, if you're running a Mastodon instance, you're probably well-aware of the downsides of centralization and would only…

> I think you're confusing what you wish was true with what is actually true.

And you are cherry-picking poorly sourced anecdotes to better suite your position.

A VPS with 100Mbps virtual adapter physically can't withstand DoS from single attacker with fiber connection (or equivalent of it). This does not have much to do with anatomy of DoS attacks, just simple math.

Cloudflare subsidizes their free users by giving a bit of bandwidth for free — the amount, that can be purchased from a decent hoster for several hundreds dollars. Of course, an attacker with several hundreds dollars can easily rent a botnet, that will demolish that "protection".

Re: Cloudflare is turning off the internet for me

#277
post #229

Earlier quoted context omitted.

I always recommend setting custom user-agents for a problematic page instead of setting them globally. For the Google issue, qutebrowser v1.9.0 does that already, see https://github.com/qutebrowser/qutebrowser/issues/5182

So can do Falkon :) Having a Chrome UA is a MUST on webkit based browsers if you want Google's taxing services such as Earth/Maps/Gmail and so on being faster and smoother than ever. Seriously. Once you open Street View on luakit/vimb with a Chrome UA, the diff is night and day.

I tried with Street View im vimb. I don't see any difference - it's slow to the point of being almost unusable, while it works fine in qutebrowser.

Re: Cloudflare is turning off the internet for me

#278
post #17

The problem presented by services like ReCaptcha and Cloudflare is a tough nut to crack. They're silently embedded in a huge portion of modern websites, and the average user will never even know about them. But it seems to be way too easy for them to blanket-ban or serve an absurd amount of captchas to powerusers, linux gurus, privacy geeks, or anyone with the wrong combination of browser+addons. And the failures (as…

Yeah, you can't really talk about downsides of Recaptcha/Cloudflare without also acknowledging the extreme amount of malicious actors and abuse on the internet. We're in a "this is why we can't have nice things" predicament and you have malicious actors to thank for that, yet most people on HN only seem capable of attacking the few affordable solutions to that problem. I'm even down with the theory that Cloudflare is…

> Let's hear some real solutions

The old recaptcha which did not need js, did not serve you with unsolvable challenges, and did not refuse to serve you because you used tor/because you used the audio challenge too much.

Re: Cloudflare is turning off the internet for me

#279

FYI, the new/current version Qutebrowser just added a built in list of websites that require a "Chrome/chromium" UA - it also added logic so that parts of the UA can be auto updated. Shameless shill: Qutebrowser is by far the best browser I've every used. The half measure of using addons (even powerful ones like Pentadactyl) cannot be compared to having a browser that is power user friendly in every aspect, from conf…

imo, they should have used the Chrome UA as a default for all sites. Leaking to sites what browser the user is using does not seem very privacy-respecting.

Re: Cloudflare is turning off the internet for me

#280
post #17

The problem presented by services like ReCaptcha and Cloudflare is a tough nut to crack. They're silently embedded in a huge portion of modern websites, and the average user will never even know about them. But it seems to be way too easy for them to blanket-ban or serve an absurd amount of captchas to powerusers, linux gurus, privacy geeks, or anyone with the wrong combination of browser+addons. And the failures (as…

Yeah, you can't really talk about downsides of Recaptcha/Cloudflare without also acknowledging the extreme amount of malicious actors and abuse on the internet. We're in a "this is why we can't have nice things" predicament and you have malicious actors to thank for that, yet most people on HN only seem capable of attacking the few affordable solutions to that problem. I'm even down with the theory that Cloudflare is…

What ever happened to proof of work protocols? I remember in the 00's they were being touted as The Solution™ to our spam/bot woes. Are botnets just so large that even PoW doesn't significantly affect them?
Post reply on HN