Scraping Hacker News on a Schedule with TaskPipes

#1

Post by f292 » Wed, Sep 23, 2015, 8:17 AM UTC

Scraping Hacker News on a Schedule with TaskPipes
blog.taskpipes.com

Re: Scraping Hacker News on a Schedule with TaskPipes

#2

Post by fulafel » Wed, Sep 23, 2015, 9:24 AM UTC

This general category of tool seems very useful. Apparently there are many Yahoo Pipes followers. http://www.makeuseof.com/tag/12-best-yahoo-pipes-alternative...

Support for email and HTML tables seem to be some distinguishing features of this one.

Re: Scraping Hacker News on a Schedule with TaskPipes

#3

Post by draugadrotten » Wed, Sep 23, 2015, 9:59 AM UTC

Looks pretty but I can't find pricing information.

Re: Scraping Hacker News on a Schedule with TaskPipes

#4

Post by johnong » Wed, Sep 23, 2015, 10:43 AM UTC

I tried NewsBlur as an alternative to Yahoo Pipes. Like it because it has an Android app as well.

Re: Scraping Hacker News on a Schedule with TaskPipes

#5

Post by bold » Wed, Sep 23, 2015, 11:40 AM UTC

draugadrotten wrote: post #3

Looks pretty but I can't find pricing information.

I was looking for prices as well, or any other indicator for that matter that the tool will be available for a reasonable time at least.

Re: Scraping Hacker News on a Schedule with TaskPipes

#6

Post by iag » Wed, Sep 23, 2015, 12:23 PM UTC

bold wrote: post #5

draugadrotten wrote: post #3

Looks pretty but I can't find pricing information.

I was looking for prices as well, or any other indicator for that matter that the tool will be available for a reasonable time at least.

+1

I love these tools but before I invest more of my time leveraging this in my workflow I'd want to know that it'll be around for another few months at least...

Re: Scraping Hacker News on a Schedule with TaskPipes

#7

Post by ins0 » Wed, Sep 23, 2015, 12:27 PM UTC

draugadrotten wrote: post #3

Looks pretty but I can't find pricing information.

Chatted with one of the guys

We're starting to move TaskPipes out of beta at the moment, but our pricing will start at $50/month for the service

Re: Scraping Hacker News on a Schedule with TaskPipes

#8

Post by giarc » Wed, Sep 23, 2015, 1:52 PM UTC

fulafel wrote: post #2

This general category of tool seems very useful. Apparently there are many Yahoo Pipes followers. http://www.makeuseof.com/tag/12-best-yahoo-pipes-alternative... Support for email and HTML tables seem to be some distinguishing features of this one.

I thought I remember reading that Yahoo was discontinuing the pipes tool?

Re: Scraping Hacker News on a Schedule with TaskPipes

#9

Post by chdir » Wed, Sep 23, 2015, 2:11 PM UTC

I've seen something similar more than once on HN but my google-fu is failing. What other similar services are out there that'll let you smartly scrape a page into a spreadsheet.

In the past, I've tried Google spreadsheets with "ImportXML" option but got frustrated after a bit and resorted to python.

Re: Scraping Hacker News on a Schedule with TaskPipes

#10

Post by dhruvkar » Wed, Sep 23, 2015, 2:14 PM UTC

chdir wrote: post #9

I've seen something similar more than once on HN but my google-fu is failing. What other similar services are out there that'll let you smartly scrape a page into a spreadsheet. In the past, I've tried Google spreadsheets with "ImportXML" option but got frustrated after a bit and resorted to python.

Kimonolabs.com

Allows you to scrape then import that data into a google spreadsheet. But its not the only way to consume the data.