141–150 of 179 posts
Earlier quoted context omitted.
Anubis' white lists and block rules are configurable though. The defaults are a bit silly.
The default is to allow non-Mozilla user agents so that existing (good) automation continues to work and so that people stopped threatening to burn my house down. Lovely people in the privacy community.
Looks like Anubis is also blocking robots.txt which seems to defeat the point of having robots.txt in the first place.
This is why I see (well managed) government digital IDs as sensible moves. Apart from DDOS attacks, if bots have to “prove” who they are on each request it seems like a win-win. I may be missing something of course
> Before it was enabled, it was getting several hundred-thousand requests each day. As soon as Anubis became active in there, it decreased to about 11 requests after 24 hours I love experimental data like this. So much better than gut reaction that was spammed when anubis was just introduced
Well yeah, but I also didn't make it through to the actual site. That can't be the idea, right? After 5 seconds of 100% CPU and no progress I gave up. The idea is to scare off bots and not normal humans.
Earlier quoted context omitted.
> The click IDs are likely to make the traffic look more like a human who has clicked a link rather than a bot? It's certainly possible. However, the traffic is still coming from Facebook's network with a FB proxy PTR record in DNS. Seems much more likely to fool your typical site owner than a bad actor.
> Seems much more likely to fool your typical site owner than a bad actor. Sorry, I wasn't clear. That is exactly what I think they would be doing. While it won't fool blocks that check source first it will fool those who allow requests with those IDs through because they can't afford to block their content appearing on the distraction media sites.
Earlier quoted context omitted.
> Every transaction I make either identifies me through bank, railway or other id, or quite simply by my face standing in front of the coffee seller. My walk down the road is observed by neighbours and postmen. Are these the government? Is the bank the government? Is the rail company the government? No? Then you have answered your own question. A silo of identification between you and a service provider that uses the…
The problem here is that pretty much every part of modern life has been government and capitalism riding in the same cart - from cities installing electric power stations 100 years ago, to roads and inventions like the transistor and internet itself was government and private capital working towards common goals. The issue is we want “good” government and “good” corporate behaviour but not the bad. And knowing the di…
And here is your argument’s fatal flaw: mistaking public works, that benefits the commons and society as a whole, with government tracking.
The two are NOT the same.
AI companies and notably AI scrapers are a cancer that is destroying what's left of the WWW. I was hit with a pretty substantial botnet "distributed scraping" attack yesterday. - About 400,000 different IP addresses over about 3 hours - Mostly residential IP addresses - Valid and unique user agents and referrers - Each IP address would make only a few requests with a long delay in between requests It would hit the se…
Greed and ignorance have taken over the tech industry.
AI companies and notably AI scrapers are a cancer that is destroying what's left of the WWW. I was hit with a pretty substantial botnet "distributed scraping" attack yesterday. - About 400,000 different IP addresses over about 3 hours - Mostly residential IP addresses - Valid and unique user agents and referrers - Each IP address would make only a few requests with a long delay in between requests It would hit the se…
Thanks for sharing the perspective here. I think a lot of folks on HN have rightly said that a lot of the problems with the modern internet are due to the ad-supported business model. I don't think you were ever going to move away from it voluntarily -- too many people support it, even if they grumble about it. But maybe (and likely for worse) LLMs will finally kill this model.
The minute the internet dies for good, the chat bots will run half-locally and request payments to stop recommending VRAM enlarging pills.