Live data from Hacker News

Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

knownagents.com

121–130 of 243 posts

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#121

Earlier quoted context omitted.

I don't even have a domain name and I'm getting lots of hits.

I recently brought up a website on a never-before-seen .com domain. Within about 10 mins of bringing it up with a SSL certificate, Anthropic came knocking on the door requesting the front page. (Almost certainty due to them watching the Public Certificate Transparency logs)

How do you know who's visiting? Reverse IP lookups? Or do they announce it in the headers?

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#122
post #118

Earlier quoted context omitted.

Yeah, that’s pretty interesting! You can also see a live view of the ASN/ISP leaderboard by going to https://knock-knock.net and choosing ISP from the carousel. That’s ordered by bot transaction count rather than IP count though. It never ceases to amaze me that these ISPs don’t bother to shut down the botnets. They could do so very easily. For example, they could identify the IP address of every bot that hit this ho…

What if I have a slimy TV box or nasty on my phone, living on my network? You take IP down, you kill the cancer but you also end up killing the patient.

Not the person you are asking but site operators can not tell intent. It could be something nasty on the network or a botter feigning ignorance.

I'd say its probably an acceptable casualty in the battleground that is the internet especially for little one-off sites hosting blogs, forums, chat servers, etc... For a bigger site I would expect that person may have to open a ticket with the platform such as Amazon accepting that some CDN's and firewalls may be harder to get the block removed. This is why we can't have nice things.

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#123

Earlier quoted context omitted.

Your router doesn't care about their DNS settings. IP addresses are very easy to tie back to countries. The reason they say it's not reliable is because it's trivial to spoof the country, but even so, a lot of attackers don't even bother. It's sort of like the Nigerian prince scam calls: if you're wise enough to block Russia, you're not worth their time. Your firewall vendor should supply you with country lists, just…

I wonder if adding the US is now sensible.

Unless you're serving something, you should probably drop all incoming requests. If you are serving something, the US is a pretty big market to lock yourself out of.

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#124
post #100

Earlier quoted context omitted.

By default they use 2.0 [1] unless someone or an addon disables it or unless the person is on a really old version. OperaMini however will use 1.1. No idea if anyone here uses OperaMini. There are some reader apps that act as a proxy that only support http/1.1. Be careful, some of those are not just readers and do not trust what they claim to be the source code. Some of them are created by cute and fuzzy bunnies. The…

Apparently nginx didn't enable it on my new server... why it's not enabled by default, I don't know... I retract my idiocy :P

No idiocy, sometimes defaults change or don't get updated by a deployment script. Different distributions may have a slightly different default configuration file depending on how involved the artifact maintainer is with the project. Or put another way, I've done far sillier things.

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#126
post #121

Earlier quoted context omitted.

I recently brought up a website on a never-before-seen .com domain. Within about 10 mins of bringing it up with a SSL certificate, Anthropic came knocking on the door requesting the front page. (Almost certainty due to them watching the Public Certificate Transparency logs)

How do you know who's visiting? Reverse IP lookups? Or do they announce it in the headers?

I saw it via the User-agent header + confirmed via IP ownership lookup.

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#127
post #122
post #118

Earlier quoted context omitted.

What if I have a slimy TV box or nasty on my phone, living on my network? You take IP down, you kill the cancer but you also end up killing the patient.

Not the person you are asking but site operators can not tell intent. It could be something nasty on the network or a botter feigning ignorance. I'd say its probably an acceptable casualty in the battleground that is the internet especially for little one-off sites hosting blogs, forums, chat servers, etc... For a bigger site I would expect that person may have to open a ticket with the platform such as Amazon accept…

thats the hard part, right - my 76 year old dad is on his banking app while his samsung TV is allowing a bot to try and take over other accounts at the same bank on the same IP.

IP Blacklists, no matter how good can't stop this. You have to start using stats or deep-diving telemetry.

https://darknetdiaries.com/episode/172/

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#128

Earlier quoted context omitted.

I don't even have a domain name and I'm getting lots of hits.

I recently brought up a website on a never-before-seen .com domain. Within about 10 mins of bringing it up with a SSL certificate, Anthropic came knocking on the door requesting the front page. (Almost certainty due to them watching the Public Certificate Transparency logs)

Had a bit setup a new Wordpress install before I could lock it down. I was very confused why a brand new install didn’t give me the setup page before seeing in the logs someone had automated it. Pure evil to be scraping new renewals and dns changes to look for this kinda stuff.

For the record I thought I had this site behind basic auth.

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#129
post #118

Earlier quoted context omitted.

Yeah, that’s pretty interesting! You can also see a live view of the ASN/ISP leaderboard by going to https://knock-knock.net and choosing ISP from the carousel. That’s ordered by bot transaction count rather than IP count though. It never ceases to amaze me that these ISPs don’t bother to shut down the botnets. They could do so very easily. For example, they could identify the IP address of every bot that hit this ho…

What if I have a slimy TV box or nasty on my phone, living on my network? You take IP down, you kill the cancer but you also end up killing the patient.

Nothing wrong with contacting the customer, and taking down the IP briefly until the customer can deal with their malware hosting toaster.

However, I can see the argument for giving the customer 24-48 hours to resolve the problem.

Re: Someone is running mass vulnerability scans, spoofing AI bots like ClaudeBot

#130

On average about 100 (TCP) requests hit my home router per minute doing various probing and scanning. Lots of checking for the telnet port obviously. Sometimes you can see a swarm of entirely different IPs scanning the full port range (probing the ports one-by-one). You'll see a lot of deepfield, censys-scanner, visionheight.com, shadowserver.io, etc., but also the usual suspects of Chinese or Russian IPs. With OpenW…

fail2ban?
Post reply on HN