Live data from Hacker News

Dead Man's Snitch – Monitoring for Scheduled Tasks

deadmanssnitch.com

21–30 of 39 posts

Re: Dead Man's Snitch – Monitoring for Scheduled Tasks

#21

So instead of MAILTO=sendmail I use MAILTO= http://deadmandssnitch/report or similar?

That would actually be more stable, since it would rely on a network designed for fault-tolerant redundant store-and-forward messaging. Instead, each cron job runs an HTTP GET, and later you can view the service's website to see the tests that have requested successfully or haven't responded at all. Unfortunately for your system, if there's a network hiccup, you won't know why your jobs failed and the job will hang o…

Unfortunately for your system, if there's a network hiccup, you won't know why your jobs failed and the job will hang on the HTTP call. Also, you're paying for it instead of just sending e-mail alerts to yourself.

Critically importantly for this use case, if you are doing something critical for your business (say, backups or your daily billing run or sending reminders to thousands of people or what have you) and something goes wrong with your network and makes you unable to curl, you get told about that. If you instead do self-hosted email, and your network fails, you don't get told about that.

It's fail-open vs. fail-close. That's literally so core to the product it is alluded to in the name. A Dead Man's Switch doesn't go off if anything goes wrong, it goes off if everything doesn't go right.

Re: Dead Man's Snitch – Monitoring for Scheduled Tasks

#22
post #11
post #8

Nice branding. Most monitoring tools are overly complicated, both in their features as well the use-cases they try to cover. I like the clear focus of this; the product itself doesn't require one to invest a lot of time, which is a good thing. Just some questions: - how do you prevent unauthorized snitches from screwing with your data? Wouldn't it be wise to limit a snitch to a certain server ip? - why only an iOS ap…

You do realize that 600 dollars a year is next to nothing for a business? I don't even run a business, I am just a freelancer, but I'd happily pay 600 USD/year for this service if I needed it. The price doesn't make a real dent in any serious budget, so why bother? And 600 dollars is really cheap compared to anything that could happen when you miss an important event. Email campaign not sent? This could cost thousand…

"I don't even run a business, I am just a freelancer, but I'd happily pay 600 USD/year for this service if I needed it."

Yes, you do run a business, yourself. But outside that...

The problem with this sort of thinking is that, yes, sure, if you need it, you could happily pay $600/year for this service, and another, and another, and another, and pretty soon you're dropping $5-$10k on services. For a large business, that's probably not an issue (but even then, it's always out of someone's budget, not the entire company's), but for smaller companies, you're approaching a pain threshold.

Re: Dead Man's Snitch – Monitoring for Scheduled Tasks

#23
Nice job! -- we actually needed this so badly a few years back that I wrote a simple app in a day to do this myself, though it's not very robust. I am actually surprised it's taken so long for someone to offer a SaaS version. Your pricing is so reasonable that I'd switch to your app if you could just flush out one more feature.

I actually don't want another app for reporting. I already use a monitoring service (pingdom) and would prefer to keep all of our "alerts" organized through a single service.

Could you offer a http-based public status page? Our system allowed each snitch to be tagged with a tag like "net.tourbuzz.db.replication.upToDate" and then a url like http://foo.com/deadoralive?filter=net.tourbuzz would allow us to use a single Pingdom monitor to alert us if any of snitches in that namespace failed.

This is a simple tagging structure that makes it easy to organize large numbers of snitches into manageable groups and easily integrate it into existing monitoring/alerting infrastructure.

Feel free to email me directly if you want more info.

Re: Dead Man's Snitch – Monitoring for Scheduled Tasks

#26
Been using DMS for years now (it was recently bought by Collective Idea). Love it so much that I'm on the testimonials page.

The reason we started using it is because it's hard to notice the absence of an email alerting you that job xyz is complete. E.g. when our nightly backup would complete, we'd get an email. We'd also get N other emails nightly emails about other tasks that would run.

On the rare occasion that e.g. backup wouldn't complete it would be really tough to notice that you didn't get the email.

What you really want is to hear nothing UNLESS something goes wrong, which DMS makes happen. Love love love it.

Re: Dead Man's Snitch – Monitoring for Scheduled Tasks

#27
post #11
post #8

Nice branding. Most monitoring tools are overly complicated, both in their features as well the use-cases they try to cover. I like the clear focus of this; the product itself doesn't require one to invest a lot of time, which is a good thing. Just some questions: - how do you prevent unauthorized snitches from screwing with your data? Wouldn't it be wise to limit a snitch to a certain server ip? - why only an iOS ap…

You do realize that 600 dollars a year is next to nothing for a business? I don't even run a business, I am just a freelancer, but I'd happily pay 600 USD/year for this service if I needed it. The price doesn't make a real dent in any serious budget, so why bother? And 600 dollars is really cheap compared to anything that could happen when you miss an important event. Email campaign not sent? This could cost thousand…

>You do realize that 600 dollars a year is next to nothing for a business?

I get that. But at that price point, there are similar solutions available with much more coverage and features. This isn't actually competing with DataDog, Munin, Nagios, New Relic on features or reliability.

>? This could cost thousands of dollars or more. Backup not done? Could be millions of dollars for some kinds of businesses.

If thats the bussiness risk you are taking, you shouldn't be depending on just a ping after a cron job! Phooff. You do realize this thing is essentially only measuring if the cron job has executed. Not if it is succesfull. Sure you can script the success/failure state. But how are you going to test that against a myrid of potential failure states? What does the proccess return when the OOMKILLER gets its? Do you know?

The only reason to use something that 'just does pings' is because it's not important enough, and you don't want to invest that much time and effort. Those other tools require to be a integral part of your setup, but they'll give you much better monitoring capabilities and actual ease of mind. More importantly, rather than warning you when things have gone wrong (after the fact), they'll warn you in advance things are not looking good. They'll monitor the actual proccess, not if they were launched every hour, but what they were up to.

This product is in a very interesting niche because it seems to target projects-not-important-enough-i-wouldnt-bother-but-if-its-this-easy-why-not. But it is not priced accordingly.

>Should I ever need such a service. As I said before, I don't need it right now.

Those projects where you don't need them for: those are only ones where a product like this makes sense. If there are lots of dollars on the line, i strongly suggest you use actual industrial-grade monitoring solutions, not a ping after a cron job.

Re: Dead Man's Snitch – Monitoring for Scheduled Tasks

#28
post #11
post #8

Nice branding. Most monitoring tools are overly complicated, both in their features as well the use-cases they try to cover. I like the clear focus of this; the product itself doesn't require one to invest a lot of time, which is a good thing. Just some questions: - how do you prevent unauthorized snitches from screwing with your data? Wouldn't it be wise to limit a snitch to a certain server ip? - why only an iOS ap…

You do realize that 600 dollars a year is next to nothing for a business? I don't even run a business, I am just a freelancer, but I'd happily pay 600 USD/year for this service if I needed it. The price doesn't make a real dent in any serious budget, so why bother? And 600 dollars is really cheap compared to anything that could happen when you miss an important event. Email campaign not sent? This could cost thousand…

>If you can convince me that your service will reliably mail me on incidents no matter what catastrophe happens to your data center

You do realize that it would take years to even establish a significant baseline against a simple VPS on any cloud provider in uptime?

It's much more important that you know which cloud provider and data-centers they are using, so you can verify you aren't actually running your servers in the same data-center.

Not that they mention it on their site, but a simple traceroute will tell you their ping-server is just a (bunch of?) Amazon instance(s). And Amazon is never down, right?

If somebody can convince you that their service will never be down, it's just means you gullible.

On the other hand, if your monitoring-service is in a different data-center from a different cloud provider, statistically speaking, chances are low, that your system and their system will be down at the same time. But you can expect a few false positives. With this kind of setup, you could get false positives just because outside-internet is not working.

Again, one would not use something like this for sensitive large scale productions. But very few large scale productions are sensitive, and very few sensitive productions are large scale.

Yet, if its this easy, why not slab it on every system anyway? Oh wait, the price.

Re: Dead Man's Snitch – Monitoring for Scheduled Tasks

#29
post #13

As an aside, does anyone make a cron panel for humans? I'd find that really useful as I'm usually so busy being distracted by the next big thing that I forget to take care of repetitive tasks. I know I can achieve something like that with my Google Calendar but I don't like the way repeating events fill it up -- it would be better if they just showed for the next occurrence.

I use FollowUpThen - https://www.followupthen.com/

It does a lot of stuff, but I have it email me every Thursday to remind me to take the trash to the curb. Its just an email, not a calendar alert, but it keeps the clutter off the calendar and I usually see an email within a couple hours anyway.

Re: Dead Man's Snitch – Monitoring for Scheduled Tasks

#30

as much as I hate to admit it, jenkins makes a superb replacement for cron. It keeps a history, has excellent error handling capabilities, and can scale quite well. also the integration with git and the like makes updating jobs super easy.

Hudson/Jenkins works well for us. We've moved all our scheduling jobs out of cron and other uglier options (like maestro) into Hudson.

In addition to sending emails when things break, it can also post to our Twitter feed and send SMS alerts.

Post reply on HN