Live data from Hacker News

Ban me at the IP level if you don't like me

boston.conman.org

271–280 of 516 posts

Re: Ban me at the IP level if you don't like me

#271

Earlier quoted context omitted.

[flagged]

[flagged]

is your trigger-word "Ethereum"? he's not even talking about trading crypto or anything you could remotely consider scammy, he's talking about a blockchain based naming system. you're freaking out over nothing, go home man...

Re: Ban me at the IP level if you don't like me

#272
post #213

Earlier quoted context omitted.

This is wrong. Unless maybe you're from the east end of london.

I’m not claiming everyone pronounces it that way. But he’s an ero, we need to find an ospital, ninety miles an our. You will find government documents and serious newspapers that refer to an hospital.

Generic American English pronounces the 'h' in hospital, hero, heroine, but not hour.

Same is true for RP English.

Therefore, for both accents/dialects, the correct phrases are "a hotel", "a hero", "a heroine", and "an hour".

Cockney, West Country, and a few other English accents "h drop" and would use "an 'our", "an 'otel", etc.

Re: Ban me at the IP level if you don't like me

#273
post #126

We solved a lot of our problems by blocking all Chinese ASNs. Admittedly, not the friendliest solution, but there were so many issues originating from Chinese clients that it was easier to just ban the entire country. It's not like we can capitalize on commerce in China anyway, so I think it's a fairly pragmatic approach.

Lately I've been thinking that the only viable long-term solution are allowlists instead of blocklists. The internet has become a hostile place for any public server, and with the advent of ML tools, bots will make up far more than the current ~50% of all traffic. Captchas and bot detection is a losing strategy as bot behavior becomes more human-like. Governments will inevitably enact privacy-infringing regulation to…

It all started with an inverted killfile...

Re: Ban me at the IP level if you don't like me

#274
post #144

Earlier quoted context omitted.

Changing the SSH port also helps cut down the noise, as part of a layered strategy.

Are you familiar with port knocking? My servers will only open port 22, or some other port, after two specific ports have been knocked on in order. It completely eliminates the log files getting clogged.

I've used that solution in the past. What happens when the bots start port knocking?

Re: Ban me at the IP level if you don't like me

#275

I'm always a little surprised to see how many people take robots.txt seriously on HN. It's nice to see so many folks with good intentions. However, it's obviously not a real solution. It depends on people knowing about it, and adding the complexity of checking it to their crawler. Are there other more serious solutions? It seems like we've heard about "micropayments" and "a big merkle tree of real people" type soluti…

robots.txt isn't the law

Re: Ban me at the IP level if you don't like me

#276
> A further check showed that all the network blocks are owned by one organization—Tencent. I'm seriously thinking that the CCP encourage this with maybe the hope of externalizing the cost of the Great Firewall to the rest of the world.

A simple check against the IP address 170.106.176.0, 150.109.96.0, 129.226.160.0, 49.51.166.0 and 43.135.0.0 showed that these IP addresses is allocated to Tencent Cloud, a Google Cloud-like rental service.

I'm using their product personally, it's really cheap, a little more than $12~$20 a year for a VPS, and it's from one of the top Internet company.

Sure, it can't really completely rule out the possibility that Tencent is behind all of this, but I don't really think the communist needs to attack your website through Tencent, it's just simply not logical.

More likely it's just some company rented some server on Tencent crawling the Internet. The rest is probably just your xenophobia fueled paranoia.

Re: Ban me at the IP level if you don't like me

#278
post #213

Earlier quoted context omitted.

I’m not claiming everyone pronounces it that way. But he’s an ero, we need to find an ospital, ninety miles an our. You will find government documents and serious newspapers that refer to an hospital.

Generic American English pronounces the 'h' in hospital, hero, heroine, but not hour. Same is true for RP English. Therefore, for both accents/dialects, the correct phrases are "a hotel", "a hero", "a heroine", and "an hour". Cockney, West Country, and a few other English accents "h drop" and would use "an 'our", "an 'otel", etc.

Now do historic. Suddenly all Brits turn into Cockney's.

Re: Ban me at the IP level if you don't like me

#279
post #134

I think a lot of really smart people are letting themselves get taken for a ride by the web scraping thing. Unless the bot activity is legitimately hammering your site and causing issues (not saying this isn't happening in some cases), then this mostly amounts to an ideological game of capture the flag. The difference being that you'll never find their flag. The only thing you win by playing is lost time. The best wa…

My friend has a small public gitea instance, only use by him a a few friends. He's getting thousounds of requests an hour from bots. I'm sorry but even if it does not impact his service, at the very least it feels like harassment

I have a small public gitea instance that got thousands of requests per hour from bots.

I encountered exactly one actual problem: the temporary folder for zip snapshots filled up the disk since bots followed all snapshot links and it seems gitea doesn't delete generated snapshots. I made that directory read-only, deleted its contents, and the problem was solved, at the cost of only breaking zip snapshots.

I experienced no other problems.

I did put some user-agent checks in place a while later, but that was just for fun to see if AI would eventually ingest false information.

Re: Ban me at the IP level if you don't like me

#280

I think a lot of really smart people are letting themselves get taken for a ride by the web scraping thing. Unless the bot activity is legitimately hammering your site and causing issues (not saying this isn't happening in some cases), then this mostly amounts to an ideological game of capture the flag. The difference being that you'll never find their flag. The only thing you win by playing is lost time. The best wa…

The way I get a fast web product is to pay a premium for data. So, no, it's not "lost time" by banning these entities, it's actual saved costs on my bandwidth and compute bills. The bonus is my actual customers get the same benefits and don't notice any material loss from my content _not_ being scraped. How you see this as me being secretly taken advantage of is completely beyond me.

When you're a business that serves specific customers, it's justifiable to block everyone who isn't your customer. Complaints about overblocking are relevant to public sites, not yours.
Post reply on HN