Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Grafana Mimir – Horizontally scalable long-term storage for Prometheus

grafana.com

Post reply on HN
Print view View original

21–30 of 121 posts

Re: Grafana Mimir – Horizontally scalable long-term storage for Prometheus

#21

Post by netingle »

halfmatthalfcat wrote: post #5

How does this stack up with https://github.com/thanos-io/thanos , which I've used to pretty good success. The only criticism I have of Thanos though was the amount of moving pieces to maintain.

(Tom here; I started the Cortex project on which Mimir is based and lead the team behind Mimir)

Thanos is an awesome piece of software, and the Thanos team have done a great job building an vibrant community. I'm a big fan - so much so we used Thanos' storage in Cortex.

Mimir builds on this and makes it even more scalable and performance (with a sharded compactor and query engine). Mimir is multitenant from day 1, whereas this is a relatively new thing in Thanos I believe. Mimir has a slightly different deployment model to Thanos, but honestly even this is converging.

Generally: choosing Thanos is always going to be a good choice, but IMO choosing Mimir is an even better one :-p

Re: Grafana Mimir – Horizontally scalable long-term storage for Prometheus

#23

Post by eatonphil »

pracucci wrote: post #20
eatonphil wrote: post #9

It's hard to tell exactly how this works but judging from the tutorial's docker-compose.yml [0] it looks like this runs as a separate API next to Prometheus and you tell Prometheus to write [1] to Mimir. I'm unclear how reads work from it or maybe there is no read? Maybe I'm completely misunderstanding. [0] https://github.com/grafana/mimir/blob/main/docs/sources/tuto... [1] https://github.com/grafana/mimir/blob/main/…

Mimir exposes both remote write API and Prometheus compatible API. The typical setup is that you configure Prometheus (or Grafana Agent) to remote write to Mimir and then you configure Grafana (or your preferred query tool) to query metrics from Mimir. You may also be interested into looking at a 5 minutes introduction video, where I cover the overall architecture too: https://www.youtube.com/watch?v=ej9y3KILV8g

Cool! Personally I don't like watching videos, preferring to read prose or code or see an arch diagram. But good that it's available.

Re: Grafana Mimir – Horizontally scalable long-term storage for Prometheus

#24

Post by k8sToGo »

bboreham wrote: post #17
eatonphil wrote: post #9

It's hard to tell exactly how this works but judging from the tutorial's docker-compose.yml [0] it looks like this runs as a separate API next to Prometheus and you tell Prometheus to write [1] to Mimir. I'm unclear how reads work from it or maybe there is no read? Maybe I'm completely misunderstanding. [0] https://github.com/grafana/mimir/blob/main/docs/sources/tuto... [1] https://github.com/grafana/mimir/blob/main/…

It’s a centralised multi-tenant store, supporting the Prometheus query API. So you can point clients directly at Mimir, they send in PromQL and they get data back in Json. (Note I work on Mimir)

But who does the scraping of the prometheus agents? Mimir or still prometheus server?

Re: Grafana Mimir – Horizontally scalable long-term storage for Prometheus

#25

Post by netingle »

dikei wrote: post #16

Sad news for Cortex, with most of the maintainer moving on to Mimir, I fear it's pretty much dead in the water.

We tried to address this question on the Q&A blog post: https://grafana.com/blog/2022/03/30/qa-with-our-ceo-about-gr...

It doesn't have to mean the end for Cortex, but others will have to step up to lead the project. We've tried to put other maintainers in place to kick start this.

Re: Grafana Mimir – Horizontally scalable long-term storage for Prometheus

#28

Post by detaro »

cfors wrote: post #19

More engineering effort going into reinventing things that already exist to upsell people on Grafana cloud. What about focusing on the core value that Grafana provides, dashboards? Grafana 8 alerting is still in my opinion at a beta level. Dashboards as code has made no meaningful progress outside of community attempts in the past 3 years. The documentation for Grafana 8 alerts is still subpar. All of these things as…

Is there any competitor in the "primarily dashboards" space? Plenty things I know just use Grafana for small amounts of data where all this "5 new datastores!" isn't really useful, but dashboard improvements would be welcome.

Re: Grafana Mimir – Horizontally scalable long-term storage for Prometheus

#29

Post by maccard »

candiddevmike wrote: post #11
notamy wrote: post #4

Earlier quoted context omitted.

You have to find the "Download" button and click it, it's very non-obvious :< The entire page seems to be designed to funnel you into signing up for their paid service, which makes sense, but still doesn't feel great...

Recently switched from their cloud service back to on-premise. The cloud version wasn't being updated and the entire setup experience left a lot to be desired with how you connect their on-premise grafana agent, especially if you aren't using their easy button deployment stuff. Also, billing for metrics is insane, as on any given day my metric load may vary between 5-7k or more. This caused some operational overhead…

> For $50/mo, you can self host everything easier, cheaper and with more control IMO.

Can you give an example as to how you could self host a grafana stack for $50/month? On AWS that buys you 4 cores, 8GB memory and 0 storage, and it's certainly not easier than clicking one button on the grafana website.

Re: Grafana Mimir – Horizontally scalable long-term storage for Prometheus

#30

Post by bboreham »

eatonphil wrote: post #18
bboreham wrote: post #17

Earlier quoted context omitted.

It’s a centralised multi-tenant store, supporting the Prometheus query API. So you can point clients directly at Mimir, they send in PromQL and they get data back in Json. (Note I work on Mimir)

Is there an example of running mimir without prometheus?

For example sending metrics from an OpenTelemetry pipeline.

Mimir accepts the Prometheus remote-write api, which is protobuf-over-http; can be generated by anything really.

Post reply on HN