Live data from Hacker News

Ask HN: Have you ever used anti detect browsers for web scraping?

news.ycombinator.com

21–27 of 27 posts

Re: Ask HN: Have you ever used anti detect browsers for web scraping?

#21

this smells like an ad for GoLogin

Or a covert ad for the substack.. given their only other submission was the substack. Either way it doesn't really matter, it was a fair post and brought up an interesting idea of stealth browsers though I don't think they work all that well.

Agreed

Re: Ask HN: Have you ever used anti detect browsers for web scraping?

#26

I've found that it's almost never needed. Most of the "advanced AI human detection" things are glorified IP reputation systems. So you just need a few IPs that would be way too painful to block, for example US residential IPs, and you're good. But if you really want to make sure, it's pretty easy to remote-control a cheap Android phone. Plus detection thresholds tend to be much higher on mobile, because filling out a…

Could you use some kind of android emulator for this task instead of an actual phone?

Re: Ask HN: Have you ever used anti detect browsers for web scraping?

#27

I've found that it's almost never needed. Most of the "advanced AI human detection" things are glorified IP reputation systems. So you just need a few IPs that would be way too painful to block, for example US residential IPs, and you're good. But if you really want to make sure, it's pretty easy to remote-control a cheap Android phone. Plus detection thresholds tend to be much higher on mobile, because filling out a…

Could you use some kind of android emulator for this task instead of an actual phone?

Not if the antibot product is checking canvas and gpu render hashes. If you present a random hash instead of a well-known hash for an iPhone or flagship Android handset, that generally registers as a red flag.
Post reply on HN