Live data from Hacker News

Prometheus reaches 1.0

prometheus.io

41–50 of 60 posts

Re: Prometheus reaches 1.0

#41
post #36
post #22

Earlier quoted context omitted.

Not quite, though there is some overlap. Someone else asked me to compare Prometheus to other tools in the APM (application performance monitoring) space, and I'm going to share the summary I came up with: The way I would describe Prometheus in relation to those other tools: - Prometheus is open-source and self-hosted. - Prometheus is about dimensional numeric time series metrics only (no log-based analysis, no per-r…

> Prometheus is about dimensional numeric time series metrics only (no log-based analysis, no per-request tracing, etc.). Any thoughts on a companion (open source) system that focuses more on logs and such?

For tracing check out sysdig's new 'tracers' functionality. Tracing for Microservices, transactions, all the way down to system calls. www.sysdig.org

Re: Prometheus reaches 1.0

#42

What is the scale out process with Prometheus? Is sharding/replication a manual setup process or is it automated? What's involved in scaling out?

There is an project we've just started: https://docs.google.com/document/d/1C7yhMnb1x2sfeoe45f4mnnKC...

Hopefully have something to show for promcon.

Re: Prometheus reaches 1.0

#43
Is Prometheus still pull only or is there a first class push option? This always rubbed me the wrong way.. of course most metrics collection scrapes at some level, but push/streaming at the infrastructure level is easier to integrate with and compose processing pipelines with..

Re: Prometheus reaches 1.0

#44
post #36

Earlier quoted context omitted.

> Prometheus is about dimensional numeric time series metrics only (no log-based analysis, no per-request tracing, etc.). Any thoughts on a companion (open source) system that focuses more on logs and such?

For tracing check out sysdig's new 'tracers' functionality. Tracing for Microservices, transactions, all the way down to system calls. www.sysdig.org

All that and the only cost is a third-party kernel module :)

Re: Prometheus reaches 1.0

#45
post #43

Is Prometheus still pull only or is there a first class push option? This always rubbed me the wrong way.. of course most metrics collection scrapes at some level, but push/streaming at the infrastructure level is easier to integrate with and compose processing pipelines with..

There is no first-class push option.

I don't see why processing pipelines would be special for push vs. pull, it's generally a wash.

Re: Prometheus reaches 1.0

#46
post #26
post #25

Earlier quoted context omitted.

Yes, I have to collect metrics in a very restricted and separated production environment then ship them over to a completely separate system for reporting. My impression is that Prometheus just isn't the right fit.

That depends - but yeah, those situations can be tricky sometimes. If you are pushing metric states regularly though (more than every 5m) or don't set client-side timestamps, that usually works though. But maybe you have an even more special use case there regarding those metrics and the staleness?

Basically I don't want to hassle with transferring stats until it's worth it (collecting enough before making the transfer), rather than being forced into streaming them due to this contstraint.

Thanks for your responses.

Re: Prometheus reaches 1.0

#47
post #43

Is Prometheus still pull only or is there a first class push option? This always rubbed me the wrong way.. of course most metrics collection scrapes at some level, but push/streaming at the infrastructure level is easier to integrate with and compose processing pipelines with..

It's still focused on pull, while there is the Pushgateway (see https://prometheus.io/docs/instrumenting/pushing/ and https://prometheus.io/docs/practices/pushing/) for dealing with one-off situations where you cannot scrape something. Pull works great in most situations where people have their own private clouds or datacenters, but it's less suitable for very restrictive environments where you can't run Prometheus on the same network or behind the same firewall as the targets you want to monitor.

In the usual cases, pull has many benefits however:

- You can get high availability by simply running two identically configured, independent Prometheus servers. No clustering required.

- You can run a copy of production monitoring (or similar) on your laptop without changing production. This is great for experimentation and testing changes.

- You get free up-ness monitoring via scrapes and can use this for alerting.

- When there's an HTTP pull endpoint on service instances, you can also go there manually as a human and check out the current metrics state of any target, independent of the Prometheus server.

- Knowledge of service identities is inverted: instead of each service instance having to know its own identity (usually instance="hostname:port" and some job/service name), the monitoring system knows (usually via some form of service discovery) what instances should be there and how they are labeled, and proactively checks on them. Services have no knowledge of where the monitoring system lives anymore, enabling the above use cases.

- Debatable, but push-based monitoring systems can make it easier for someone to accidentally DDoS your monitoring. (still possible with pull, but you have one central place where you know what you pull from)

Re: Prometheus reaches 1.0

#48

Congrats! Prometheus + grafana are a killer duet! Easy to setup and use. Same goes for node_exporter. I only wish more JVM apps included a configuration file for the jmx_exporter and an easier to setup nginx_exporter. :) Incidentally yesterday I created a simple exporter for (linux) coretemp, hddtemp and NUT's upsc: https://github.com/andmarios/sensor_exporter

I really hope upstream node_exporter is happy adding new exports!

Still slowly hacking on my homelab Prometheus bringup, but I've already got a start developing a battery level/power supply exporter. By far the most important Node information I want metrics and alarms on in my developer life! https://github.com/rektide/node_exporter/tree/export-battery

Almost went with a standalone Node exporter, but I decided I'd try some Go, and tour some of the Prometheus codebase. MustNewConstMetric is a very confusing thing to me, but hopefully I'm on the right track! Feeling double-inspired to get my homelab Prometheus up and going right now, between renewed excitement for these exporters and the 1.0! So close!

Re: Prometheus reaches 1.0

#49
post #2

Prometheus cofounder here - we're happy to take any questions. Huge congrats to everyone who made this release possible and for all the excellent work over the years that lead up to this!

Could you elaborate on what seems to be your focus on logging only. Would Prometheus be relevant, for say, high frequency financial markets data? I note that Prometheus "has knowledge about what the world should look like" and "actively tries to find faults" [1]. Isn't this something which is applicable to other fields than simply monitoring? I spend a lot of my time watching and managing "bad data" coming through in finance....

[1] https://prometheus.io/docs/introduction/comparison/

Re: Prometheus reaches 1.0

#50
post #31
post #22

Earlier quoted context omitted.

Not quite, though there is some overlap. Someone else asked me to compare Prometheus to other tools in the APM (application performance monitoring) space, and I'm going to share the summary I came up with: The way I would describe Prometheus in relation to those other tools: - Prometheus is open-source and self-hosted. - Prometheus is about dimensional numeric time series metrics only (no log-based analysis, no per-r…

Thanks! I always found NR Servers to be lacking, and frankly, I wanted a more service-oriented monitoring system that tells me how certain services are performing over time. I.e. our API performance, jobs..

Try appenlight, its open source now - https://getappenlight.com/. (disclaimer: I wrote it). I think it does exactly what you are looking for.
Post reply on HN