It looks like a great service but at that pricing it almost exactly doubles my hosting cost. I can get "good enough" with cacti, nagios and pingdom. I can see expensive plans for enterprises moving to the cloud, but for small founders and ISV's an extra $100 could buy five more Linode instances.
Back in the day I was very penny-wise and pound-foolish -- it was practically my tagline. In some ways I still am. But I've learned about reimplementing stuff outside my core competencies. It doesn't matter that $100 or whatever sounds like a lot of money to me, or that $100 can buy a lot of slices or software or pizza for that matter. What does matter is that setting up cacti/nagios/etc takes time. That is time wher…
Also, do you really spend all day doing A/B tests or do you have 'marginal' time that you could dedicate to other things? I think we (maybe not you; I'm speaking in general) make the mistake of saying that since we bill at X dollars an hour, that our time is worth that. It isn't: you can't fill all your hours with pay work all the time.