Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: How do you earn a living from scraping in 2018?

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 31 posts

Re: Ask HN: How do you earn a living from scraping in 2018?

#11

Post by hoerzu »

dchuk wrote: post #8

Are you just tinkering with all of those ideas above? Or where are you finding these ideas? Like others have said, start with the problem, rather than coming up with solutions first. Do you have any of the things you listed on github or anything? Curious to checkout a few of them.

Well tinkering is the right word. I build a GitHub Repo recommender. Which check what users who starred a repo also starred. And I did a data science christmas calendar for 24 days.

My main goal was to use browser automation for arbitrage.

you can find some old projects here in german. https://franz.media/

Re: Ask HN: How do you earn a living from scraping in 2018?

#12

Post by jholman »

I have a related question. How do you earn a living from scraping, in any year? Is that a thing? Was that ever a thing?

Like others have said: earn money by doing things that people want enough to pay you for.

It's like asking "how do you earn a living giving good names to variables in 2018?"

Re: Ask HN: How do you earn a living from scraping in 2018?

#13

Post by hoerzu »

jholman wrote: post #12

I have a related question. How do you earn a living from scraping, in any year? Is that a thing? Was that ever a thing? Like others have said: earn money by doing things that people want enough to pay you for. It's like asking "how do you earn a living giving good names to variables in 2018?"

Well i think the possibilities can go beyond reach. Flight search engines, many shops are basically curated scraped data. Good names for variables in 2018 -> maybe good names for domains.

Re: Ask HN: How do you earn a living from scraping in 2018?

#15

Post by duskwuff »

hoerzu wrote: post #9
paulcole wrote: post #3

You don't earn a living from scraping, you earn a living by solving a problem and providing value. What problems are your projects solving? Are people were paying (in either effort or money) to solve these problems currently?

I give a price prediction for the rent of a house. So the buyer can immediately calculate ROI.

You do? Or the sites you're scraping do?

Re: Ask HN: How do you earn a living from scraping in 2018?

#17

Post by DoreenMichele »

srednalfden wrote: post #16
verismal wrote: post #6

Microsoft rewards. Live off Amazon gift cards

For real, or jesting?

You can make about $10 per month via Microsoft rewards with a limit of one account per person, five accounts per household. So unless you can survive on $50/month,this would violate the terms of service.

https://answers.microsoft.com/en-us/bing/forum/bing_other-bi...

Re: Ask HN: How do you earn a living from scraping in 2018?

#18

Post by mrtnmcc »

Don't be too discouraged by the negative comments. Half of ML, optimization algorithms is pulling in valuable data. Companies with data monopolies could help innovation by sharing it with others more creative than them.

Stick diverse data feeds in a neural network and try to predict earnings for companies, energy demand or something else valuable to know in advance? Build off some of the ideas that Google trends/insights offer?

Always thought someone should put together a 'bittorrent client for scraping' where you can make large distributed queries as long as you service others.

Post reply on HN