Live data from Hacker News

Show HN: MrScraper – A visual web-scraping tool

mrscraper.com

81–85 of 85 posts

Re: Show HN: MrScraper – A visual web-scraping tool

#81

Curious how well ChatGPT could write css selectors for these no code scrapers. If running the model was cheaper I would even say run the whole page through ChatGPT and ask it to format the information on the page for you.

Already tried that. Not worth it with the current token limitations.

But I'm currently tinkering with other applications of AI and MrScraper. Will ship something when I think it's reliable enough.

Re: Show HN: MrScraper – A visual web-scraping tool

#82

Curious how well ChatGPT could write css selectors for these no code scrapers. If running the model was cheaper I would even say run the whole page through ChatGPT and ask it to format the information on the page for you.

I haven't looked at many web scrapers. Do most use CSS selectors? What about xpath? I always found xpath to be much more powerful.

Re: Show HN: MrScraper – A visual web-scraping tool

#84
post #62

Glad to see this text """ What happens if my scraping fails? Not to worry! We will make every effort to determine the cause of the problem and assist you in resolving any issues with your scraper. Additionally, please note that unsuccessful scrapings will not be included in your monthly quota. """ I'm curious the feedback mechanism for failed scrapes. Is there any validation configuration or an email notification I c…

If the target page or DOM changes, it's not considered a failed scraping, just the data you wanted will return empty. But you gave me the idea to send an alert or email notification if a scraper stops returning data or content changes. Thanks

totally, that's going to be a huge piece of functionality that will add a ton of value to the user. It's what I always worry about in maintaining my scrapers, updating xpaths, all the rigmarole parsing and what not. Stable pages are much appreciated but we all know web designers are gonna design. Thanks for making this product, being in a post https://en.wikipedia.org/wiki/HiQ_Labs_v._LinkedIn world is gonna make for some great adventures I think. Keep up the good work.
Post reply on HN