Live data from Hacker News

Web Scraping Is Vital to Democracy

themarkup.org

131–132 of 132 posts

Re: Web Scraping Is Vital to Democracy

#131
post #20

I think of web scraping as nothing less than automation of human work. There really is no hacking or unauthorized access involved. It's either me, using a browser, to read something publicly accessible on the internet, or it's my computer, which I've programmed to read those things for me, so I can focus on creative work or spend time with friends and family. This applies not only to personal life, but businesses as…

I totally agree with the first part where you say it's fine to scrape. It is just an automation. But you don't mention what you do with this data after. 1. You store it somewhere (not in your brain) 2. You extract value out of it (directly or indirectly) That's why I understand why it is a problem for those who publish this data. One thing I always try to say to everyone who argues about web scraping: web scraping is…

I'm agree, 100%.

Re: Web Scraping Is Vital to Democracy

#132
post #119
post #82

Earlier quoted context omitted.

I think web-scraping is ok but it should be treated as copyrighted data. Let's take a real example: We've built a company that creates ratings for doctors via a private process. We'd like the doctors to be able to show their good rating on their website via a linked widget. How do we stop a competitor from not only scraping our data but using it as their own and/or selling it to someone else?

By network effects and brand loyalty.

We're small with no funding. Our competitors have $100Ms of VC funding. How do we even get network effects and brand loyalty?
Post reply on HN