Show HN: CloudScrape – Cloud-based web scraping platform
cloudscrape.com
Show HN: CloudScrape – Cloud-based web scraping platform
1–10 of 109 posts
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#2I found it really really expensive regarding to what it's offering. May be I'm missing the point here.
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#3I found it really really expensive regarding to what it's offering. May be I'm missing the point here.
I used to work for PriceRunner, and I remember that while scraping a site and extracting content from the results was easy, avoiding rate limits and handling all the edge cases was hard. From the feature list it seems that CloudScrape is running full headless browsers, so handles JavaScript, allows screengrabs and that stuff is expensive.
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#4Are there open source alternatives to services like this and Diffbot? Boilerpipe and similar libraries are ok but targeted at article extraction.
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#5Anyone interested in 'similar' tools/platforms:
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#6I need to add their IP range to my blocklist.
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#7I need to add their IP range to my blocklist.
Why? People will just scrape your data anyway.
What you put online is public. Treat the web the same as a public bulletin board. Everything you post will be readable by everyone. Trying to prevent this is pointless.
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#8I need to add their IP range to my blocklist.
Why? People will just scrape your data anyway. What you put online is public . Treat the web the same as a public bulletin board. Everything you post will be readable by everyone. Trying to prevent this is pointless.
It might be desirable to make data available to humans, but not bots, no?
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#9Hmm, another cool web scraper is import.io
I use to think web scraping was limited to obscure proprietary companies like connotate so I'm glad to see more of these tools becoming available for everyone to utilize and hopefully create something cool.
Re: Show HN: CloudScrape – Cloud-based web scraping platform
#10I need to add their IP range to my blocklist.
Why? People will just scrape your data anyway. What you put online is public . Treat the web the same as a public bulletin board. Everything you post will be readable by everyone. Trying to prevent this is pointless.
There have been lawsuits where the company running the site-being-scraped sued the scraper and won. So while it's technically possible, there can be legal issues.