Live data from Hacker News

Grafana 4.0 with alerting is released

grafana.org

51–60 of 91 posts

Re: Grafana 4.0 with alerting is released

#51
post #3

This release has been long in the making. We started on Alerting way back in March this year and it's finally released! Read more about all the highlights in the release here: http://grafana.org/blog/2016/11/09/grafana-4.0-beta-release/ Oh, and if your in New York tomorrow, signup for GrafanaCon: http://grafanacon.org

Great work! Including a way to set grace periods will be really useful to prevent flapping on the metrics. ex, 'Alert When CPU > 95% for 10m'

Re: Grafana 4.0 with alerting is released

#52
post #33

Is anyone using a log management tool in conjunction with Grafana? I.e. if you see something anomalous or see an alert triggered, how do you investigate what's going on?

You can use ElasticSearch as an annotation provider over the top of your time series metrics. We publish events from our continuous deployment pipeline into ES and then surface those in a generic application dashboard. There hasn't been a deployment that we didn't already know about, but in theory when more users are going through CD it will provide more of a heads up.

Re: Grafana 4.0 with alerting is released

#53

Quick note for the ones who are tired of the giant clusterfuck of open-source tools for monitoring + alerting + storage + other, which is no less than: - statsd - collectd - graphite - whisper - carbon - prometheus - grafana - seyren - riemann - nagios - icinga - zabbix There are multiple modern SaaS software that will do all of that in a single tool with better integrations, more polish, less work and no maintenance…

And you have include in the price the problems of a paid app:

- customization will be very expensive, if not impossible

- you must have people for the procurement process (x10 more costly if you are in a gov agency),

- weird failures due to not finding the license,

- your cheap personal that install software won't be able to do it,

- you'll have problems creating testing environments because you don't have licenses

- you won't be able to do some things immediately because there aren't enough licenses.

And these are just the problems that came to my mind right now. All of them are real problems that I'd found in commercial software.

Re: Grafana 4.0 with alerting is released

#54

Earlier quoted context omitted.

To have been on the maintainer sides of the OSS tools, your statement is untrue. The OSS tools costs a fortune in human to maintain them, and another fortune in hardware to run it.

Datadog will cost you $165,600 a year for 600 hosts. That is objectively equal to a very well paid engineer. So no, the statement is not untrue. (I picked 600 because that was the approximate number of machines we had at my last job, where we used Graphite maintained by one guy, part time). You included a LOT of redundancy in your OSS list. Multiple timeseries databases. Multiple collection daemons. Multiple dashboar…

Yikes. I'm sure there's discount pricing available but some of us have tens of thousands of hosts to monitor. The pricing you quoted doesn't scale. For me it might be cheaper to collect with OSS and graph with SaaS.

Re: Grafana 4.0 with alerting is released

#56
post #14
post #3

This release has been long in the making. We started on Alerting way back in March this year and it's finally released! Read more about all the highlights in the release here: http://grafana.org/blog/2016/11/09/grafana-4.0-beta-release/ Oh, and if your in New York tomorrow, signup for GrafanaCon: http://grafanacon.org

Congrats on release! We've been using Grafana for a few years now, and personally built-in alerting is the only thing I would have added. Some may argue that this "violates" good concern separation practices, but honestly you are going to be alerting about the same data you feed to Grafana, so at the end of the day it makes a lot of sense. Call it a "two in one" if you will. Either way this will make monitoring with…

Note that keeping them separate has a benefit that when your 'Visualization' portal is down, your 'Alerting' systems are unaffected (and vice versa).

Collectd, telegraf. etc, can be configured to send the same metrics to your favorite TSDB and Alerting system (like riemann) in parallel.

Re: Grafana 4.0 with alerting is released

#57
post #39

Earlier quoted context omitted.

Was this an older build? We had serious issues at first, but our setup is pretty stable these days.

Last I tried was 1.0. I love everything about using Influx but it would die and never restart and every time it would some crash on semacquire. I'll have to try it again since I need to check out this Grafana update anyway.

There's some setup involved if you're sending a decent amount of traffic to it.

The two game changers are using the UDP line protocol instead of HTTP, and making sure you are batch-processing inputs. Fixing these settings is the difference between an instances that crashes all the time, and a purring one.

Re: Grafana 4.0 with alerting is released

#58
post #11

I'm currently using Prometheus, Grafana, and Alertmanager. I'm a big fan of the linux terminal, versioned config files, and separation of concerns but the rest of my team prefers web interfaces so I'm basically the only one maintaining Alertmanager. Grafana Altering looks appealing. What have other people had success with?

I've had success with killing all the s * free open source tools (Grafana, graphite, prometheus, whisper, icinga, nagios, carbon, ganglia, influxdb, zabbix...) And using a single paid tool that does the job better AND doesn't kill me in maintenance work. See https://www.datadoghq.com/ as leader or https://signalfx.com/ as the second comer, or http://www.bmcsoftware.uk/it-solutions/truesight.html if you're enterprisey…

At my current gig the network is air-gapped. At previous gigs even though we had Internet access, security was very tight. They also seem to rather pay 40+ hours of dev salary installing and supporting open-source or home grown tools instead of having an ongoing subscription for a few bucks a month.

Re: Grafana 4.0 with alerting is released

#59
post #6

Grafana really looks interesting, and it is interesting that you can add all the different backends to it, for an example I didn't know you can use Elasticsearch as a timeseries backend. Is it correct that Grafana works best with Graphite? At least that seems to be my impression, and it is a bit sad, since I think Graphite is cool, but it really has a lot of moving parts.

We use it with influx, works great, though I find influx's syntax to be funky.

We also use it against mysql. Annoyingly there is no driver for that so we had to build a nasty layer than translates from influx to mysql.

Post reply on HN