71–80 of 84 posts
Is there anything easier for logs? Basically glorified ripgrep?
shameless plug for uptimeFunk ( https://uptimefunk.com ) that i soft launched a some time ago. I wanted some uptime monitoring with nice ui and a few advanced features that i didn't find anywhere: - monitoring mongo db/replicaset status - monitoring sql databases with basic sql queries - monitoring host cpu, ram and disk usage - monitoring docker containers - and being able to monitor all of this through ssh tunnels…
Earlier quoted context omitted.
I think there's nothing currently that combines both logging and metrics into one easy package and visualizes it, but it's also something I would love to have. Vector[1] would work as the agent, being able to collect both logs and metrics. But the issue would then be storing it. I'm assuming the Elastic Stack might now be able to do both, but it's just to heavy to deal with in a small setup. A couple of months ago I…
Nice experiment. Side note: it should be possible to tweak some config parameters to optimize the memory usage or cpu usage of quickwit. Ask us on the discord server next time :)
Yeah, I was a little bit surprised it was so close. And I've been using tantivy (the library which powers quickwit afaik) in another side project where it used comparatively less.
Might jump in there then as an excuse to fiddle a bit more with the homelab soon then :)
This confirms to me what I suspected when I was trying to determine whether to host my own Grafana stack or use the Grafana Cloud free tier - that I'd end up spending a ton of time fiddling with a constellation of services I didn't actually care about that I could spend on the projects and services I do care about. I've not found it too hard to stay within the limits of the free tier. The 10 dashboards limit is the m…
IIRC grafana cloud requires to use their importer which was a no-start for me. Also 14 days retention is not useful for home, I want to know temperature and power stats from last winter, not from last 2 weeks. Even the "first paid" tier contains only 13 months of retention I just used VictoriaMetrics all-in-one binary for home stuff + grafana as visualisation
Is there anything easier for logs? Basically glorified ripgrep?
I collect logs with Vector on each instances and sent to central ClickHouse which Metabase reads from.
check out netdata if y'all haven't already - incredible software
I don't like its own UI but no need to use it and it can easily gather metrics from systemd services and containers.
Is there anything easier for logs? Basically glorified ripgrep?
Don't use Grafana for logs. Its (or any other basically, including Kibana or Graylog) interface sucks and I used Metabase which has much more friendly interface to show logs in tabular format instead of throwing raw logs like the others. I collect logs with Vector on each instances and sent to central ClickHouse which Metabase reads from.
Used this tutorial:
https://clickhouse.com/docs/en/integrations/vector
My services usually produce around 2GB of log data per day. From quick read on the CH I beleive it should not be a problem. Not sure how big the database it is but zip compressed log data is around that size for entire month.
Is there anything easier for logs? Basically glorified ripgrep?
I think Loki is pretty much the easiest thing you can find (if you want it to be multi server, at least). Loki whole approach comes down to avoiding expensive indexing (compared to Elastic search et all.), and really on "grep" for searching instead.
I tried loki around v1.0 and it didn't seem to offer much back then...
Earlier quoted context omitted.
I use Telegraf (collector) + Influx (storage) + Grafana (visualization and alerting). Telegraf is amazingly simple to use for collection and has a ton of plugins available.
I also started with that stack, but swapped out InfluxDB for Postgres + TimescaleDB extension, which adds timeseries workflows (transparent partitioning, compression, data retention, continuous aggregates, …). I found InfluxDB to be lacking in terms of permissions management, flexibility regarding queries (SQL, joins), data retention, ability to debug problems. In Postgres, for example, I can look into the execution…
I was interested in swapping out InfluxDB, but it turned out to be somewhat difficult to send data from Telegraf to Postgres. It's not as simple as making an HTTP post, like you can do with InfluxDB.
I went down the Grafana rabbit hole, and without a doubt, it's a fantastic tool. It can handle just about any kind of data you throw at it, and when it comes to visualizing time series data, it's second to none. That said, it's a slog to set up and configure, but once finished, I had a beautiful dashboard for my home media server, and life was good. Unfortunately, a few months later, I was forced to upgrade and lacke…
Is there way to self-host the netdata "cloud"?
I don't know if it has the same features or not, but it looks like you can set it up yourself.