Show HN: Monitor websites for change and get scraped data in a webhook
1–10 of 25 posts
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#2Hello HN,
Monitoro is a service I built to watch websites for changes, scrape data, and whenever the data changes send it to a webhook of your choice.
It started as a scratch-your-own-itch kind of situation where I wanted to monitor the prices for some stuff to buy, until I decided to make a product out of it to help others solve similar issues.
I am available to answer any questions you might have.
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#3This is ideal for a new feature I’d like to add to our service. My concern is that you won’t stick around - does the on premise version continue work if you were to close?
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#4This is ideal for a new feature I’d like to add to our service. My concern is that you won’t stick around - does the on premise version continue work if you were to close?
Glad to hear that!
We can agree on a license to ensure exactly what you asked.
Please write me to omar -at- monitoro.xyz to discuss this further.
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#5Writing a scraper is easy. So I assume the special sauce in these tools is caching, not getting banned or rated limited. Mostly could be done with Tor but still doesn't work with some sites like Craigslist. Is that right?
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#6Writing a scraper is easy. So I assume the special sauce in these tools is caching, not getting banned or rated limited. Mostly could be done with Tor but still doesn't work with some sites like Craigslist. Is that right?
It depends on your usage.
If you're parsimoniously checking for data, the website will not be hostile.
If your usage requires higher frequency against a given website, you'll indeed need a proxy (which we'll be rolling relatively soon, when there is demand for it).
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#7Love the idea. Totally understand the business use case. Not in love with the pricing.
Feels like paying $49/mo is too high for a marketer to try out, but too low for the fact you can run an effective DDoS of some sites with it
I'd suggest changing the buckets - up to 10 monitored pages on free, a Silver Tier of maybe $29/mo of up to 100 pages + frequency of as low as hourly, a Gold Tier of maybe $99/mo of up to 1000 pages w/ minute frequency, Zapier integration, better support, etc, and then a call-for-quote tier like you already have
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#8Love the idea. Totally understand the business use case. Not in love with the pricing. Feels like paying $49/mo is too high for a marketer to try out, but too low for the fact you can run an effective DDoS of some sites with it I'd suggest changing the buckets - up to 10 monitored pages on free, a Silver Tier of maybe $29/mo of up to 100 pages + frequency of as low as hourly, a Gold Tier of maybe $99/mo of up to 1000…
It looks like at most, you can update every 30 minutes. So you aren't going to be doing any DDoS'ing with this.
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#9When I click on the "Start Monitoring for FREE" button on the homepage, I get redirected to the /login web page. Shouldn't it link to the register page so I can create a FREE account?
Re: Show HN: Monitor websites for change and get scraped data in a webhook
#10I am trying it out. But I get a 403 error when trying to create my first new monitor. It's a silent error in the background. Had to open the network inspector to see it because it just sits there.