Show HN: Kimono – Never write a web scraper again • Hacker News Board

Re: Show HN: Kimono – Never write a web scraper again

#11

Post by szidev » Wed, Jan 15, 2014, 10:19 PM UTC

great idea. i'll have to keep this in mind for future projects.

Re: Show HN: Kimono – Never write a web scraper again

#12

Post by pranade » Wed, Jan 15, 2014, 10:20 PM UTC

jmcgough wrote: post #10

Really sleek interface, and looks like it could be extremely useful (I just spent a few hours cranking out Nokogiri this morning). Oh, typo: "Notice that toolbar at the toop of the screen?"

Awesome, thanks for the kind words. And for catching that typo, will fix that now

Re: Show HN: Kimono – Never write a web scraper again

#13

Post by iurisilvio » Wed, Jan 15, 2014, 10:20 PM UTC

What about some navigation tools there?

Looks pretty good, but it does not really replace my scrappers. Maybe some of them...

Re: Show HN: Kimono – Never write a web scraper again

#14

Post by dmunoz » Wed, Jan 15, 2014, 10:22 PM UTC

I'm normally a bit worried when a thread quickly fills up with praise, but this looks very nice.

It's something I have thought about, as I'm sure many people who have done any amount of scraping have, but never went forward and tried to implement. The landing page with video up top and in-line demo is a pretty slick presentation of the solution you came up with. Good job.

Re: Show HN: Kimono – Never write a web scraper again

#15

Post by trip41 » Wed, Jan 15, 2014, 10:22 PM UTC

iurisilvio wrote: post #13

What about some navigation tools there? Looks pretty good, but it does not really replace my scrappers. Maybe some of them...

re: nav tools -- you mean the ability to crawl multiple pages?

Re: Show HN: Kimono – Never write a web scraper again

#16

Post by kenrikm » Wed, Jan 15, 2014, 10:23 PM UTC

Looks awesome, however I keep getting errors and 404s. Could this be an issue on my end (seems to be working for others) or just HN making the servers beg for mercy?

Re: Show HN: Kimono – Never write a web scraper again

#17

Post by ForHackernews » Wed, Jan 15, 2014, 10:24 PM UTC

This looks really slick. What happens if a website you're scraping changes its design? Do you respect robots.txt?

Re: Show HN: Kimono – Never write a web scraper again

#18

Post by jjcm » Wed, Jan 15, 2014, 10:24 PM UTC

Very cool, and I like that the link is your announcement page running inside of the demo. Really drives home the idea.

That said, it looks like it can't do media right now. I would love it if it could at least give me a url for images/other media.

Re: Show HN: Kimono – Never write a web scraper again

#19

Post by pranade » Wed, Jan 15, 2014, 10:27 PM UTC

dmunoz wrote: post #14

I'm normally a bit worried when a thread quickly fills up with praise, but this looks very nice. It's something I have thought about, as I'm sure many people who have done any amount of scraping have, but never went forward and tried to implement. The landing page with video up top and in-line demo is a pretty slick presentation of the solution you came up with. Good job.

Thanks we were pretty surprised as well, but we're really grateful for the encouragement

Re: Show HN: Kimono – Never write a web scraper again

#20

Post by lstamour » Wed, Jan 15, 2014, 10:27 PM UTC

pranade wrote: post #12

jmcgough wrote: post #10

Really sleek interface, and looks like it could be extremely useful (I just spent a few hours cranking out Nokogiri this morning). Oh, typo: "Notice that toolbar at the toop of the screen?"

Awesome, thanks for the kind words. And for catching that typo, will fix that now

I thought it was intentional. Swedish chef style. I like it, but I'll need to go back and re-read to understand how I can use this on other pages than the homepage/demo page. I've nothing immediate to try it with right now. :)

Edit: I'll watch the video after work, probably will clear everything up for me.