Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Netdata: Open-source real-time monitoring platform

github.com

Post reply on HN
Print view View original

91–100 of 108 posts

Re: Netdata: Open-source real-time monitoring platform

#91

Post by sdesol »

ktsaou wrote: post #89
sdesol wrote: post #83

Earlier quoted context omitted.

I was analyzing the activity in the netdata project and what I found interesting was this project is less active than I would have thought. See the following for insights into the project: https://public-001.gitsense.com/insights/github/repos?q=wind... In the last 30 days, there were 2 frequent and 3 occasional contributors. I honestly thought frequent contributors would have been much higher, which leads me to belie…

> they've raised about 33 million yes, this is right > if the number of people required to maintain netbase is low (relatively speaking that is) The Netdata agent is a robust and mature product. We maintain it and we constantly improve it, but: - most of our efforts go to Netdata.Cloud - most of the action in the agent is in internal forks we have. For example, we are currently testing ML at the edge. This will event…

Hey thanks for the insights. I figured effort was being spent elsewhere and/or was not visible in the public repo.

Re: Netdata: Open-source real-time monitoring platform

#92

Post by sdesol »

andrewm4894 wrote: post #90
sdesol wrote: post #83

Earlier quoted context omitted.

I was analyzing the activity in the netdata project and what I found interesting was this project is less active than I would have thought. See the following for insights into the project: https://public-001.gitsense.com/insights/github/repos?q=wind... In the last 30 days, there were 2 frequent and 3 occasional contributors. I honestly thought frequent contributors would have been much higher, which leads me to belie…

oh cool that's a nice tool. p.s. i am the only person working on ML at Netdata and i can confirm we don't gather any data for ML purposes, which is actually my biggest challenge right now :) - convincing people the ML can be useful without having lots of nice labeled data from real netdata users to be able to quantify that with typical metrics like accuracy etc. I'm hoping to introduce mainly unsupervised ML features…

> i am the only person working on ML at Netdata and i can confirm we don't gather any data for ML purposes, which is actually my biggest challenge right now :)

Yeah I would have to imagine that it would be an issue. This is just my personal opinion, but I think there should be a way to provide anonymized data for building models for anomaly detection. Maybe an opt-in feature, as it would benefit everybody using netdata, but this is just my own personal opinion.

Re: Netdata: Open-source real-time monitoring platform

#93

Post by Havoc »

ktsaou wrote: post #63
Havoc wrote: post #2

It’s very neat for individual servers Doesn’t work well for monitoring multiple servers though from what I can tell.

Hi. I am the founder of Netdata. We complement the Netdata agent with Netdata.Cloud, a free-forever SaaS offering that maintains all the principles of the Netdata agent, while providing infrastructure level monitoring and several additional convenience features. In Netdata.Cloud, infrastructure is organized in war-rooms. On each war-room you will find the "Overview" page, that provides a fully automated dashboard, ve…

>I am the founder of Netdata.

Awesome! I see the free tier is indeed looking generous. Just hooked up a node and looks good - I like the calculate correlations on alerts thing in particular.

>Keep in mind that Netdata.Cloud is a thin convenience layer on top of the Netdata agent.

I see. Didn't know/understand that.

On the claim node page - could you perhaps add the kickstart bash script code too? I find myself needing them one after the other yet they're on different pages

Re: Netdata: Open-source real-time monitoring platform

#94

Post by ARandomerDude »

mekster wrote: post #11

All these graphs are never really actionable and are only of interest for a short period of time and you won't be looking at it after a while because they don't mean anything unless you know where and when the problem is. A sever admin wants "Incident" panel that only shows anomaly components at the top coupled with adjustable alerting mechanism and not just a dump of all the data there is blindly. There are so many…

I completely disagree. I work on a system with multiple servers communicating with each other and billions of events per day. Watching the meters wiggle on all the servers simultaneously is a really important debugging tool. If something slows down or goes down, and you know what it's connected to, it's pretty easy to troubleshoot what the cause is at an incredibly specific level just by looking at the meters.

I think it's likely one's take on whether these tools are useful is very dependent on the system architecture.

Re: Netdata: Open-source real-time monitoring platform

#95

Post by linsomniac »

ktsaou wrote: post #63
Havoc wrote: post #2

It’s very neat for individual servers Doesn’t work well for monitoring multiple servers though from what I can tell.

Hi. I am the founder of Netdata. We complement the Netdata agent with Netdata.Cloud, a free-forever SaaS offering that maintains all the principles of the Netdata agent, while providing infrastructure level monitoring and several additional convenience features. In Netdata.Cloud, infrastructure is organized in war-rooms. On each war-room you will find the "Overview" page, that provides a fully automated dashboard, ve…

>Keep in mind that Netdata.Cloud is a thin convenience layer on top of the Netdata agent. We don't aggregate your data.

I didn't get that from the website until just now. I was looking and looking for how much it would cost to subscribe for our 150 dev/stg/prod VMs -- usually that's the killer.

Re: Netdata: Open-source real-time monitoring platform

#96

Post by andrewm4894 »

Havoc wrote: post #93
ktsaou wrote: post #63

Earlier quoted context omitted.

Hi. I am the founder of Netdata. We complement the Netdata agent with Netdata.Cloud, a free-forever SaaS offering that maintains all the principles of the Netdata agent, while providing infrastructure level monitoring and several additional convenience features. In Netdata.Cloud, infrastructure is organized in war-rooms. On each war-room you will find the "Overview" page, that provides a fully automated dashboard, ve…

>I am the founder of Netdata. Awesome! I see the free tier is indeed looking generous. Just hooked up a node and looks good - I like the calculate correlations on alerts thing in particular. >Keep in mind that Netdata.Cloud is a thin convenience layer on top of the Netdata agent. I see. Didn't know/understand that. On the claim node page - could you perhaps add the kickstart bash script code too? I find myself needin…

Good to hear metrics correlation might be useful to you, just as background you can get more info here: https://www.netdata.cloud/blog/netdata-cloud-metric-correlat...

At the moment it's based on a short window of data so the focus is more for short term changes around an area of interest you have already found.

Longer term it would be cool to be able to use an anomaly score on the metrics themselves (or if a lot of alarms happen to be going off) to automatically find such regions for you so its more like surfacing insights to you as opposed to you having to already know a window if time you are interested in.

Re: Netdata: Open-source real-time monitoring platform

#97

Post by jitl »

I run Netdata on my home server using the official docker image. I mostly use it to detect run-away containers, and monitor system temprature. For these use-cases, it works great, and I like that it's self contained; way less headache than stringing together Graphviz stuff, or setting up Nagios or Prometheus.

Beware - by default it'll send home telemetry, and the web UI will try to "register" your instance with some kind of cloud. I find this super annoying, but it's possible to turn it off; just not well documented.

There's also a lot of plugins that scrape many kinds of logs, look at process data, etc. Again, might be useful, but for a home user it's much better to turn it all off.

My notes here have a write-up of how to run Netdata via Docker with example config files that disable the unwanted features here: https://jake.tl/notes/2019-11-09-cozy-server#netdata

Re: Netdata: Open-source real-time monitoring platform

#98

Post by linsomniac »

We have a central influxdb with telegraf metrics among others, and some grafana graphs.

I still install netdata on every machine though. Almost never use it, but there have been some times where it was useful to look at netdata. It's light weight enough that it hasn't been a problem.

Re: Netdata: Open-source real-time monitoring platform

#99

Post by sneak »

yunohn wrote: post #77
sneak wrote: post #51

Earlier quoted context omitted.

The telemetry isn't anonymous: it includes the client IP; the method you use to transmit the data cannot work anonymously. Additionally, what's actually unfair is that you proceed with this spying without the consent of the user. Being upfront about it is not obtaining consent: it's just informing the user you're about to violate their (lack of) consent. You must obtain consent from the user first, before transmittin…

Dude, seriously? You choose to willfully install Netdata. You have to read the docs where the opt-out telemetry is clearly explained, before you can self-host it too. If you care, you can disable it. I honestly don’t understand HN. Multiple commenters deriding a free open-source project for having basic telemetry to understand feature usage.

I feel like you are willfully misunderstanding: netdata transmitting the data without consent is unethical: it's not their data to send.

I did not choose to willfully install Netdata - I don't use it because it is unethical spyware.

Telling someone "if you stay where you are, I am going to do $THING_REQUIRING_CONSENT to you in 20 minutes" is not obtaining consent if the person doesn't, say, leave the building. Being in the hospital is not a blanket consent to anything the doctor wants to do, for example.

To transmit a user's private data (their usage) to the app vendor is unethical unless the user has specifically indicated that they want that to happen. If they haven't (and simply installing the software is not that), transmitting it anyway is, at best insanely rude, and at worst actively malicious (like, for example, how Netlify's CLI used to transmit "I opt out of telemetry" events, before I got them to stop).

Calling nonconsensual spyware "basic telemetry" is a euphemism.

Re: Netdata: Open-source real-time monitoring platform

#100

Post by sneak »

andrewm4894 wrote: post #85
sneak wrote: post #51

Earlier quoted context omitted.

The telemetry isn't anonymous: it includes the client IP; the method you use to transmit the data cannot work anonymously. Additionally, what's actually unfair is that you proceed with this spying without the consent of the user. Being upfront about it is not obtaining consent: it's just informing the user you're about to violate their (lack of) consent. You must obtain consent from the user first, before transmittin…

Disclaimer - i work for Netdata Cloud. We actually mask the ip address ( https://github.com/netdata/dashboard/blob/master/src/domains... ) so it's not even sent - we just send "127.0.0.1" as the IP into our self hosted PostHog. Likewise with any URL, referrer type event properties that could leak a hostname to us - we don't want that data at all so explicitly mask it before even capturing it in our telemetry system.…

Your claim is false; the IP address cannot be "masked" the way you describe. The spy telemetry transmits the IP as the L3 source on each and every packet.
Post reply on HN