Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Scrapingworld.com – Scraping Directory: components, providers, knowledge base

scrapingworld.com

Post reply on HN
Print view View original

1–10 of 13 posts

Re: Scrapingworld.com – Scraping Directory: components, providers, knowledge base

#6

Post by hombre_fatal »

If you're going to start a directory, why wouldn't you do the research to seed it with elementary content? Your only info link is a wikipedia link about scraping and you're hoping people email you with more links.

Seems a bit bizarre to me.

Re: Scrapingworld.com – Scraping Directory: components, providers, knowledge base

#7

Post by varenc »

Interesting collection of resources.

I found the residential IP proxy services a bit eyebrow raising. This one, https://luminati.io/ethical, apparently gets their residential IPs by having app developers embed the Luminati SDK. So when you use their proxy network, your request will be routed through some oblivious person’s phone or laptop. I assume that the requests can’t be end to end encrypted and that whatever user whose device is making the request will be able to see it.

While there’s certainly some legitimate and even noble uses of residential IP proxies, I can think of plenty nefarious ones too. Must be a constant challenge for this company to combat that. If they do.

Re: Scrapingworld.com – Scraping Directory: components, providers, knowledge base

#9

Post by kaltsturm »

hombre_fatal wrote: post #6

If you're going to start a directory, why wouldn't you do the research to seed it with elementary content? Your only info link is a wikipedia link about scraping and you're hoping people email you with more links. Seems a bit bizarre to me.

You are right - we just wanted to kickstart and will work on our own for sure to add more content. What are your top links with respect to scraping?
Post reply on HN