Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: MrScraper – A visual web-scraping tool

mrscraper.com

Post reply on HN
Print view View original

31–40 of 85 posts

Re: Show HN: MrScraper – A visual web-scraping tool

#31

Post by CrypticShift »

jerriep wrote: post #12

I've had a look at a number of these "simple" (i.e ones where I don't have to write a complex script) scraping tools recently and none of them seem to support what I consider to be a fairly common scenario of navigating to sub pages. In my case I have a landing page (with pagination) with a list of records I want to extract. However, to extract the full information I need for each record, I need to click on each item…

for an (unlimited) free local option, https://webscraper.io/ may do what you want. It is simpler than this one (no proxy/scheduling/API...) but the scraping rules are quite elaborate.

Re: Show HN: MrScraper – A visual web-scraping tool

#33

Post by t_a_v_i_s »

jerriep wrote: post #12

I've had a look at a number of these "simple" (i.e ones where I don't have to write a complex script) scraping tools recently and none of them seem to support what I consider to be a fairly common scenario of navigating to sub pages. In my case I have a landing page (with pagination) with a list of records I want to extract. However, to extract the full information I need for each record, I need to click on each item…

You might want to try https://www.kadoa.com (disclaimer: I'm one of the founders)

Re: Show HN: MrScraper – A visual web-scraping tool

#37

Post by alvis »

moneywoes wrote: post #35

How big is the market for no code scrapers? Seems I see new tools daily

I'd have no doubt about the demand given the tools we see daily. However, what beg the question is why are we still interesting in pushing this tread to the top? I'm surprise to see yet another web scraper be featured on the front page on HN

Re: Show HN: MrScraper – A visual web-scraping tool

#38

Post by mellosouls »

bdcravens wrote: post #2

This marketing bit seems a bit conflicting: "With MrScraper, you won't be blocked. We use real browser instances to perform fast but human web scrapings, resulting in a much lower block ratio." "won't be blocked" implies a zero block ratio. (I do a lot of work with Puppeteer and Playwright, and some larger websites are pretty advanced at their heuristics at catching automation, so true zero really isn't a defensible…

One would hope that anti-blocking measures are implemented ethically and the documentation clarified to reflect that.
Post reply on HN