Cloudproxy – hide your scrapers IP behind the cloud
1–10 of 116 posts
Re: Cloudproxy – hide your scrapers IP behind the cloud
#2Maybe it’s a better idea to start or subscribe to an ethical scraping initiative with some user agent header that references some kind of policy and verifiable membership id
Re: Cloudproxy – hide your scrapers IP behind the cloud
#3Hiding behind any larger cloud or VPN looks futile. If there's one place to hide scraper nowadays it's Apple's iCloud+ or whatever stupid name they've picked - two proxies to mimic tor.
Re: Cloudproxy – hide your scrapers IP behind the cloud
#4Maybe it’s a better idea to start or subscribe to an ethical scraping initiative with some user agent header that references some kind of policy and verifiable membership id
I think it's a pretty safe assumption that if everyone started scraping with certain headers almost every website will blanket block those headers.
Re: Cloudproxy – hide your scrapers IP behind the cloud
#5i tend to use tor network as a proxy which enables me to request a new ip whenever i need
Re: Cloudproxy – hide your scrapers IP behind the cloud
#6Hiding behind any larger cloud or VPN looks futile. If there's one place to hide scraper nowadays it's Apple's iCloud+ or whatever stupid name they've picked - two proxies to mimic tor.
It’d be easier to use Cloudflare WARP command line client for the same purpose.
Apple uses Cloudflare for their private relay so there’s a chance that these IPs won’t be blocked.
Re: Cloudproxy – hide your scrapers IP behind the cloud
#7i tend to use tor network as a proxy which enables me to request a new ip whenever i need
quite slow and often blacklisted (by Cloudflare for example)
Re: Cloudproxy – hide your scrapers IP behind the cloud
#8Maybe it’s a better idea to start or subscribe to an ethical scraping initiative with some user agent header that references some kind of policy and verifiable membership id
Naive
Re: Cloudproxy – hide your scrapers IP behind the cloud
#9Hiding behind any larger cloud or VPN looks futile. If there's one place to hide scraper nowadays it's Apple's iCloud+ or whatever stupid name they've picked - two proxies to mimic tor.
It’d be easier to use Cloudflare WARP command line client for the same purpose. Apple uses Cloudflare for their private relay so there’s a chance that these IPs won’t be blocked.
Ironically, Cloudflare is selling both protection against scraping and tools to facilitate it.
Re: Cloudproxy – hide your scrapers IP behind the cloud
#10This is relatively easy to block, given that these companies publish their IP ranges. Similar to the Tor block, blocking "datacenter IP's" simply becomes the norm. This is why you have companies offering "resi's" or residential proxies to bypass such blocks for some years now.