Cloud Platform at Google I/O – new Big Data, Mobile and Monitoring products • Hacker News Board

Re: Cloud Platform at Google I/O – new Big Data, Mobile and Monitoring products

#31

Post by IanCal » Thu, Jun 26, 2014, 4:43 PM UTC

smoe wrote: post #29

IanCal wrote: post #28

The streaming data stuff looks extremely interesting. My main concern is around cost, unfortunately many of these things are great if you've got a massive data problem but not particularly worth it if you've got much smaller data. I'm in a rather awkward phase of having small enough data that I don't need "Scale to 1000 machines!", I want just one or a few machines occasionally but managed for me (turn on, run code,…

I'm using MITs StarCluster to quickly spin up a bunch of AWS Spot Instances, run some calculations and shut them down again. http://star.mit.edu/cluster/ http://www.youtube.com/watch?v=2Ym7epCYnSk

Thanks, I'll have a look around at that!

Re: Cloud Platform at Google I/O – new Big Data, Mobile and Monitoring products

#32

Post by kzwin » Fri, Jun 27, 2014, 6:14 PM UTC

samstave wrote: post #14

opendais wrote: post #3

Google adding cloud monitoring has me sorely tempted to abandon a side project of mine. I'm sure Google could do it better. Bah. :P

What type of monitoring? We use Stackdriver, which Google just recently bought.

We use datadog at pelotoncycle.com. My past experience was nagios but datadog is so much nicer as well as easier to scale. I looked into other services (cheaper, more expensive) before deciding on datadog.

k.z

Re: Cloud Platform at Google I/O – new Big Data, Mobile and Monitoring products

#33

Post by dpg17 » Mon, Jun 30, 2014, 2:34 PM UTC

samstave wrote: post #14

opendais wrote: post #3

Google adding cloud monitoring has me sorely tempted to abandon a side project of mine. I'm sure Google could do it better. Bah. :P

What type of monitoring? We use Stackdriver, which Google just recently bought.

DataDog is an important part of monitoring at SmarterAgent, where we use their API's and Integrations heavily, especially the CloudWatch integrations for Amazon's Web Services (AWS). Using these, we have been able to put up effective dashboards for new environments in a matter of minutes.

We leverage DD’s API primarily for eventing. For example, deployment notifications are posted to datadog, where they overlay our metrics. This has proven very useful in tracking changes due to deploys and/or configuration changes.

While we do leverage the DataDog agent for standard and custom metrics, DataDog’s ability to put together dashboards (and alerting) for AWS without any modifications to the host is what really closed the deal for us.