Thank you for building a tool I been wanting so I don't have to! Can't wait to play around with this tonight. Suggestion. Allow one to select images.
Great add. It's on our shortlist - a popular request!
Show HN: Kimono – Never write a web scraper again
81–90 of 234 posts
Re: Show HN: Kimono – Never write a web scraper again
#82In order to get data for a different product, I will have to modify the URL itself. I think same holds true for blog posts.
Re: Show HN: Kimono – Never write a web scraper again
#83Re: Show HN: Kimono – Never write a web scraper again
#84Constructive Tone: I figured that it might be nifty to scrape cedar pollen count information from a calendar and then shoot myself an email when it was higher than 100 gr/m3. This would be a pretty difficult thing to grab when scraping normally, but the app errors before loading the content: https://www.keepandshare.com/calendar/show_month.php?i=19409... JS error: An error occurred while accessing the server, please…
Thanks for letting us know. Just tried and am getting the same error. The page is loading content dynamically from another source... We'll look into this and see if we can get it working on this page
curl "https://www.keepandshare.com/calendar/fns_asynch_api.php?r=0... --data "action=getrange&i=1940971&from=2013-12-26&to=2014-02-06"
Re: Show HN: Kimono – Never write a web scraper again
#85How dedicated are you guys to making this work because I'd imagine there are quite a few technical hurdles in keeping a service like this working long term while not getting blocked by various sites?
Re: Show HN: Kimono – Never write a web scraper again
#86Like the parameter passthrough feature. Take a look at places where the parameters are part of the URL structure. For example a Target product page http://www.target.com/p/men-s-c9-by-champion-impact-athletic... In order to get data for a different product, I will have to modify the URL itself. I think same holds true for blog posts.
Re: Show HN: Kimono – Never write a web scraper again
#87Show me it working with authentication and you will have a customer. Scraping is always something you need to write because the shit you want to get is only shown when you are logged in.
Re: Show HN: Kimono – Never write a web scraper again
#88I would seriously consider rethinking that Favicon.
Re: Show HN: Kimono – Never write a web scraper again
#89really excited to see this. i've had the idea (and nearly this execution) in mind for years but no use or ambition to get it done. given the pricing though i'm almost motivated to make my own. as a hosted service the fees make sense with the offerings. but not only would i rather host my own- it would be cheaper all around. would you consider adding a free or cheap self hosted option? aside, i think there is a mislab…
Yes, we're in beta right now, while we're still working out the bugs. For beta, it's free for 30 APIs.