Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

How to Block Some of the Bots

nochan.net

Post reply on HN
Print view View original

21–30 of 158 posts

Re: How to Block Some of the Bots

#22

Post by Bender »

ACCount37 wrote: post #18
Bender wrote: post #9

Earlier quoted context omitted.

I would be interested in some examples of valid traffic that they would block. For the purposes of the document I do not consider anything from a data-center to be valid traffic. People can of course skip any or all steps, experiment with one at a time on a test server as they should.

VPN exits often "come from datacenters". And there are entire countries where the web can be unusable without. If you don't have LaLiga in your country, that doesn't mean everyone is so lucky. Blanket IP range bans, in this day and age? Basically a proclamation of incompetence.

Basically a proclamation of incompetence.

I understand your frustration. Normally a blog site would not have any or many of these measures enabled. This is more of a test site to show what could be done on any other type of site. People can pick and choose which methods to use. Some may wish to block VPNs and proxies especially on forums.

I should make an article that shows additional ways to detect VPN's, including residential.

Re: How to Block Some of the Bots

#25

Post by FabCH »

The post content is great. I personally hate the way Cloudfare has been the „default answer“ for the bot problem because Cloudfare has become the most successful MITM attack in history. We need content like this to keep the internet alive.

The added explanations by the author in this comment thread are hilarious. You sir are a good writer.

Re: How to Block Some of the Bots

#26

Post by Bender »

genodethrowaway wrote: post #24

and all valid traffic too, judging by these HN comments (and my own attempts to connect).

The comments can be misleading. About 2600 people thus far and a few bots have been able to view it. Sunday is the best day to see all the unusual browsers and applications people browse the web with. Weekdays tend to be more mainstream bog standard browsers. This is a good test.

Re: How to Block Some of the Bots

#27

Post by Barbing »

CqtGLRGcukpy wrote: post #21

If you are unable to read this, there is an archived copy at https://archive.ph/d3236

Thanks. Regretful implementation*, being a normie on iOS Safari:

https://i.ibb.co/vCDH79d0/IMG-0303.png

…and not a bot… hoping not to turn off iCloud Private Relay to read, well, anything. (Maybe Google Scholar if I really needed it, the most mainstream thing I know of with a complete and effective iCloud relay ban.)

*edit: per author’s reply elsewhere, as a test site, rather a good implementation! But other webadmins, please don’t adopt all methods if you can avoid it :)

Re: How to Block Some of the Bots

#29

Post by Bender »

Barbing wrote: post #27
CqtGLRGcukpy wrote: post #21

If you are unable to read this, there is an archived copy at https://archive.ph/d3236

Thanks. Regretful implementation*, being a normie on iOS Safari: https://i.ibb.co/vCDH79d0/IMG-0303.png …and not a bot… hoping not to turn off iCloud Private Relay to read, well, anything. (Maybe Google Scholar if I really needed it, the most mainstream thing I know of with a complete and effective iCloud relay ban.) *edit: per author’s reply elsewhere, as a test site, rather a good implementation! But other webadmin…

That makes sense. I block most data-centers and that would include much of Apple's data-centers. What I am doing is of course unorthodox for a blog. This is more of a test site to show what could be done. People can pick and choose which features they like for their particular use cases.

I could some day split it out into a blog and a demo site.

Post reply on HN