This is why I see (well managed) government digital IDs as sensible moves. Apart from DDOS attacks, if bots have to “prove” who they are on each request it seems like a win-win.
I may be missing something of course
The bot situation on the internet is worse than you could imagine
11–20 of 179 posts
Re: The bot situation on the internet is worse than you could imagine
#12Yea it's pretty bad
Re: The bot situation on the internet is worse than you could imagine
#13I'm getting this patern a lot on Prestashop websites, where thousand, to not say hundreds of thousand, of request are coming from bots not announcing themselves in the User-agent, and coming from different IP's
Very annoying. And you can't filter them because they look like legitimate trafic.
On a page with differents options (such as color, size, etc...) they'll try all the combinaisons, eating all the ressources.
Re: The bot situation on the internet is worse than you could imagine
#14Taking a 2024 report on bot loads on the Internet is like taking a 1950s Car & Driver article for modern vehicle stats.
That’s how fast the landscape is changing.
And remember: while the report might have been released in 2024, it takes time to conduct research and publish. A good chunk of its data was likely from 2023 and earlier.
Re: The bot situation on the internet is worse than you could imagine
#15This is why I see (well managed) government digital IDs as sensible moves. Apart from DDOS attacks, if bots have to “prove” who they are on each request it seems like a win-win. I may be missing something of course
/s?
Re: The bot situation on the internet is worse than you could imagine
#16I'm surprised at the effectiveness of simple PoW to stop practically all activity. I'll implement Anubis at low difficulty for all my projects and leave a decent llms.txt referenced in my sitemap and robots.txt so LLMs can still get relevant data for my site while.keeping bad bots out. I'm getting thousands of requests from China that have really increased costs, glad it seems the fix is rather easy.
>I'm surprised at the effectiveness of simple PoW to stop practically all activity.
It's even dumber than that, because by default anubis whitelists the curl user agent.
curl -H "User-agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/146.0.0.0 Safari/537.36" "https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/diff/?id=v7.0-rc5&id2=v7.0-rc4&dt=2"
Making sure you're not a bot! curl "https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/diff/?id=v7.0-rc5&id2=v7.0-rc4&dt=2"
kernel/git/torvalds/linux.git - Linux kernel source treeRe: The bot situation on the internet is worse than you could imagine
#17Hugged to death? https://web.archive.org/web/20260329052632/https://gladeart....
> we tend to take anti-bot measures very seriously
Should have have maybe prioritized differently...
Re: The bot situation on the internet is worse than you could imagine
#18This is why I see (well managed) government digital IDs as sensible moves. Apart from DDOS attacks, if bots have to “prove” who they are on each request it seems like a win-win. I may be missing something of course
You may be missing that it's easy and free for website owners to fix the problem. But it's hacker news after all. If somebody is bothered by a leaf falling on them on their walk to the corner store, the suggested solution here will be to have a full communist revolution.
Re: The bot situation on the internet is worse than you could imagine
#19Not sure what they are doing, but they don't seem to do it well.
Re: The bot situation on the internet is worse than you could imagine
#20Ok. So I get a page saying it’s verifying I’m not a bot with some kink of measurements per second and I don’t get through. Is that the point?