Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Kimono – Never write a web scraper again

kimonify.kimonolabs.com

Post reply on HN
Print view View original

121–130 of 234 posts

Re: Show HN: Kimono – Never write a web scraper again

#121

Post by pranade »

alternize wrote: post #113

looks promising! to be fully usable for me, there are some features missing: - it lacks manual editing/correcting possibilities: i've tried to create an api for http://akas.imdb.com/calendar/?region=us with "date", "movie", "year". unfortunately, it failed to group the date (title) with the movies (list entries) but rather created two separate, unrelated collections (one for the dates, one for the movies). - it lacks…

Thanks for the feedback. We're working on a feature that will allow you to edit APIs you've created and also edit the selectors and regex (right now, in advanced mode, you can see them, but cannot edit). We're looking into your bug now...

Re: Show HN: Kimono – Never write a web scraper again

#122

Post by hobs »

roryokane wrote: post #107
misuba wrote: post #88

Earlier quoted context omitted.

Seconded. I can't show that to anyone at work.

To me, the favicon merely looks like a sumo wrestler’s head with a short ponytail and scowling/serious eyebrows. I can’t tell what NSFW thing you see it as.

Spitballing here, but it could be a POV dick's eye view. I am really reaching however.

edit: Interesting downvotes, I dont mean to be rude, I am just trying to see what someone could find offensive. (I dont see the problem with the favicon)

Re: Show HN: Kimono – Never write a web scraper again

#123

Post by prolways »

roryokane wrote: post #107
misuba wrote: post #88

Earlier quoted context omitted.

Seconded. I can't show that to anyone at work.

To me, the favicon merely looks like a sumo wrestler’s head with a short ponytail and scowling/serious eyebrows. I can’t tell what NSFW thing you see it as.

Until I read this thread I also saw a sumo or an angry onion, but I believe the picture is actually a person facing away from us undoing their kimono.

Re: Show HN: Kimono – Never write a web scraper again

#124

Post by thatthatis »

pranade wrote: post #23
ForHackernews wrote: post #17

This looks really slick. What happens if a website you're scraping changes its design? Do you respect robots.txt?

If it changes the format significantly, the scraper will break, so for now you'll have to use the tool to rebuild. You will see on your API status page that it's down. As for robots.txt, we do respect it... for now we're leaving that to the user, but we're trying to implement a proactive way of checking for disallows and stopping those scrapers from being built.

Please clarify: are you saying that right now you leave respecting robots.txt to the user?

Re: Show HN: Kimono – Never write a web scraper again

#126

Post by ricardobeat »

randomdrake wrote: post #46

The presentation is beautiful and the website is great, but the tech broke so I have no idea how or if this even works. This is a wonderful concept and one I've talked about doing with others. I was really excited to try this. I watched the demo video and it seemed straightforward. I went to try and use it on the demo page it provides, going through and adding things, but when I went to save it, I just received an er…

HN pages are possibly the worst case, very hard to infer structure from due to its 1998 coding standards. You'll have a better chance with an alternative interface like http://ihackernews.com/ or http://hckrnews.com (no comments though).
Post reply on HN