Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grafana 4.0 with alerting is released

grafana.org

Post reply on HN
Print view View original

81–90 of 91 posts

Re: Grafana 4.0 with alerting is released

#81

Post by tremad »

user5994461 wrote: post #30

Quick note for the ones who are tired of the giant clusterfuck of open-source tools for monitoring + alerting + storage + other, which is no less than: - statsd - collectd - graphite - whisper - carbon - prometheus - grafana - seyren - riemann - nagios - icinga - zabbix There are multiple modern SaaS software that will do all of that in a single tool with better integrations, more polish, less work and no maintenance…

As someone who's configured and worked with almost all of the tools in this list, I can only disagree with you. The old saying of you get what you pay for is some what relevant. But the integration of the newer OSS monitoring tools is becoming increasingly awesome. Take The graphite/prometheus/elasticstack integration with grafana for instance.

I think having one pane of glass to do all passive monitoring tasks is an incredible step forward.

I am yet to see if the Active monitoring of Grafana is any good, but it does look very promising

Re: Grafana 4.0 with alerting is released

#82

Post by mattkrea »

scrollaway wrote: post #57
mattkrea wrote: post #47

Earlier quoted context omitted.

Last I tried was 1.0. I love everything about using Influx but it would die and never restart and every time it would some crash on semacquire. I'll have to try it again since I need to check out this Grafana update anyway.

There's some setup involved if you're sending a decent amount of traffic to it. The two game changers are using the UDP line protocol instead of HTTP, and making sure you are batch-processing inputs. Fixing these settings is the difference between an instances that crashes all the time, and a purring one.

Thank you. I'll check this out.

Re: Grafana 4.0 with alerting is released

#83

Post by greenleafjacob »

apeofsteel wrote: post #41
user5994461 wrote: post #30

Quick note for the ones who are tired of the giant clusterfuck of open-source tools for monitoring + alerting + storage + other, which is no less than: - statsd - collectd - graphite - whisper - carbon - prometheus - grafana - seyren - riemann - nagios - icinga - zabbix There are multiple modern SaaS software that will do all of that in a single tool with better integrations, more polish, less work and no maintenance…

Also https://www.hostedgraphite.com - We host Graphite and StatsD with Grafana dashboards, as well as alerting and integrations to several other dev tools. It's a self-funded business running for 5 years, and profitable with 14+ staff.

You guys are awesome. Can't wait to see Grafana 4.0 on hosted graphite.

Re: Grafana 4.0 with alerting is released

#84

Post by chetanahuja »

user5994461 wrote: post #35
jmedefind wrote: post #32

Earlier quoted context omitted.

I don't see how anyone can afford SaaS metrics/alert services at any sort of real scale. $15/month/host gets expensive fast. Datadog doesn't start providing discounts till you are at 1000+ hosts.

All vendors provide discount if you negotiate. ;) $15 * 500 hosts = $7500 per month. If you think it's expensive, I can only advise you to check how much the hardware will costs on EC2 to run the free tools, plus how much work it will take to get the 8 different and independent OSS tools to work not only alone but integrate together, plus how much additional work and maintenance to keep it working without hiccups (wa…

> $15 * 500 hosts = $7500 per month.

Oh that's ridiculous pricing. Any team running a server installation at any sort of scale would scoff at the pricing, and that's even before you take into account the implications of sending so much of your metrics data to a third party to be held hostage there if you decide to leave the service.

Re: Grafana 4.0 with alerting is released

#85

Post by otisg »

poezn wrote: post #33

Is anyone using a log management tool in conjunction with Grafana? I.e. if you see something anomalous or see an alert triggered, how do you investigate what's going on?

We've used Grafana with Sematext Logsene (which exposes Elasticsearch API, so it's like having Grafana talk to ES).

Here's a short howto + video: https://sematext.com/blog/2015/12/14/using-grafana-with-elas...

Re: Grafana 4.0 with alerting is released

#86

Post by otisg »

jrv wrote: post #67
all_usernames wrote: post #31

Earlier quoted context omitted.

For installations of a few hundred instances or more, some of the SaaS offerings cost more than the engineering salaries it would take to maintain the OSS tools.

Case in point: http://blog.runnable.com/post/153498635761/how-we-saved-98-o...

Unfortunately, the post doesn't share things like: how much infra is needed and how much does it cost, how much time it took to set up, how much maintenance it needs, how long upgrades of the setup take, how much time future hacking of missing features will take, and so on. After that sort of stuff is truthfully taken into account I suspect most if not all savings would be lost.

Re: Grafana 4.0 with alerting is released

#87

Post by agnivade »

scrollaway wrote: post #57
mattkrea wrote: post #47

Earlier quoted context omitted.

Last I tried was 1.0. I love everything about using Influx but it would die and never restart and every time it would some crash on semacquire. I'll have to try it again since I need to check out this Grafana update anyway.

There's some setup involved if you're sending a decent amount of traffic to it. The two game changers are using the UDP line protocol instead of HTTP, and making sure you are batch-processing inputs. Fixing these settings is the difference between an instances that crashes all the time, and a purring one.

sending data in batches gives serious performance improvements. Don't send metrics directly to influx from your app. Send them to an intermediary like statsD which will aggregate them and send it.

Shameless plug - I recently published a log router in Golang. It sends data to influx too ! (github.com/agnivade/funnel)

Re: Grafana 4.0 with alerting is released

#88

Post by agnivade »

RRRA wrote: post #50
alfalfasprout wrote: post #25

Earlier quoted context omitted.

Not sure what you mean "secure telegraph into influxdb" but we've had great success with this stack for monitoring by just embedding an HTTP server into each application that needs to be monitored. We keep the HTTP server separate from any others used by the application (i.e. it runs on a separate thread) so performance isn't impacted.

My use case is one where I have servers in different datacenters and would want to have a simple, but secure, way to fetch metrics for graphing and alerts. So, I meant encryption in transport, authentication, etc. as many solutions work well if you're monitoring "in the clear" from the backend, but not so much over the internet.

IIRC, Influx supports https too. So you just have to setup some certs and switch to https in the client.

Re: Grafana 4.0 with alerting is released

#90

Post by jhacobian »

When you team Grafana up with a general purpose database like Crate.io some pretty amazing things can happen. Not only can crate just "roll with the punches" of auto-sharding whilst dynamically scaling performance over N number of database nodes, it also possesses powerful aggregation capabilities. If that weren't enough, crate also dynamically gzips data by default which is impressive given its zippy performance.

You get all of this for free with Crate.io without giving up the flexibility of a general purpose SQL database...

Wanna start storing log data in crate as well? No problem! Just design your table schema, and API ingest layer (My favorite is NodeJS) but you can use any language you like.

Or if security (facing the public) isn't an issue (if you're on a subnet safe from the public internet) then you can certainly just use the built-in REST API which crate exposes.

With Crate, I've been able to store hundreds of GB of systems log data without worrying about silly things like table-bloat (the autosharding of partitioned tables handles the spectre of bloated table shards for me for free).

Thanks to the amazing developers over at Crate.io for taking the best of Elasticsearch and making it sane, fast, and chock-ful of SQL goodness!

Also a big thank you to the Grafana team for recognizing the potential synergies that Crate.io & Grafana could catalyse for unifying time-series & log data streams.

Post reply on HN