Live data from Hacker News

The Art of Monitoring

artofmonitoring.com

51–60 of 64 posts

Re: The Art of Monitoring

#51
post #35
post #32

Earlier quoted context omitted.

I could be bothered. When you say you have a paper, is that something yet to be published? Or is it just sitting in some dusty corner of the Internet?

It was published, in the Elsevier journal 'Information Sciences' in 1999. It appears to be the first, and the first large, collection of statistical hypothesis tests that are both multi-dimensional and distribution-free. I try to be anonymous here at HN, but I'm willing enough to send a PDF of the paper to anyone who wants a copy. E.g., ask for a copy and leave your e-mail address on your HN profile, at least tempora…

Hi graycat - could I get a copy of that paper as well, please? Thanks!

Re: The Art of Monitoring

#52
post #35

Earlier quoted context omitted.

It was published, in the Elsevier journal 'Information Sciences' in 1999. It appears to be the first, and the first large, collection of statistical hypothesis tests that are both multi-dimensional and distribution-free. I try to be anonymous here at HN, but I'm willing enough to send a PDF of the paper to anyone who wants a copy. E.g., ask for a copy and leave your e-mail address on your HN profile, at least tempora…

Hi graycat - could I get a copy of that paper as well, please? Thanks!

Sent.

Re: The Art of Monitoring

#53

Earlier quoted context omitted.

There is also icinga2. So how does one decide which one to use? For a mixed environment (windows, linux, etc) which monitoring tool is better when both server and client is considered?

IMHO Icinga 2 is also way too many moving parts. For mixed environments, you should be able to run both Prometheus and Bosun: https://prometheus.io/download/ https://bosun.org/downloads

Thanks for the information. Currently, we are using icinga + check_mk combination and mostly happy with that. However since both icinga and check_mk are going their ways, it is no longer possible to use them together. Also I want to check out some modern alternatives like the ones you suggested.

Re: The Art of Monitoring

#55
post #16

The monitoring considered in the OP is for server farms and networks where the main challenges are rates of false alarms and rates of missed detections. The challenge is to find means of monitoring that will permit selecting the rate of false alarms are willing to tolerate and, then, for that rate, get the lowest rate possible for missed detections. Thus, would like to use the Neyman-Pearson result. Usually, however,…

I'd like to see this paper as well! Email in my profile.

Re: The Art of Monitoring

#56
post #16

The monitoring considered in the OP is for server farms and networks where the main challenges are rates of false alarms and rates of missed detections. The challenge is to find means of monitoring that will permit selecting the rate of false alarms are willing to tolerate and, then, for that rate, get the lowest rate possible for missed detections. Thus, would like to use the Neyman-Pearson result. Usually, however,…

I'd like to see this paper as well! Email in my profile.

Sent.

Re: The Art of Monitoring

#57
post #48
post #35

Earlier quoted context omitted.

It was published, in the Elsevier journal 'Information Sciences' in 1999. It appears to be the first, and the first large, collection of statistical hypothesis tests that are both multi-dimensional and distribution-free. I try to be anonymous here at HN, but I'm willing enough to send a PDF of the paper to anyone who wants a copy. E.g., ask for a copy and leave your e-mail address on your HN profile, at least tempora…

I'm interested as well.

Sorry, I can't parse your statement of your e-mail address!

Re: The Art of Monitoring

#58
post #16

The monitoring considered in the OP is for server farms and networks where the main challenges are rates of false alarms and rates of missed detections. The challenge is to find means of monitoring that will permit selecting the rate of false alarms are willing to tolerate and, then, for that rate, get the lowest rate possible for missed detections. Thus, would like to use the Neyman-Pearson result. Usually, however,…

here's a good article on why anomaly detection is so hard: https://blogs.wavefront.com/2016/04/21/why-is-operational-an...

Yup. I've been saying much the same for 20+ years. Gee, now I'm no longer the only one!

Re: The Art of Monitoring

#59
post #35

Earlier quoted context omitted.

It was published, in the Elsevier journal 'Information Sciences' in 1999. It appears to be the first, and the first large, collection of statistical hypothesis tests that are both multi-dimensional and distribution-free. I try to be anonymous here at HN, but I'm willing enough to send a PDF of the paper to anyone who wants a copy. E.g., ask for a copy and leave your e-mail address on your HN profile, at least tempora…

So I think the mathematics to make this work is not the problem. How do you engineer this though? If I were to try and build a platform that could do this in real-time for, lets say, a million metrics per minute, can you engineer something that would scale horizontally to do this? Can it be done by cobbling together various open-source tools/libraries currently out there? Then how would you present the results in a w…

Hello graycat - I would be interested in a copy of your paper and/or the article name/publication date/etc. Regards

Re: The Art of Monitoring

#60

Earlier quoted context omitted.

So I think the mathematics to make this work is not the problem. How do you engineer this though? If I were to try and build a platform that could do this in real-time for, lets say, a million metrics per minute, can you engineer something that would scale horizontally to do this? Can it be done by cobbling together various open-source tools/libraries currently out there? Then how would you present the results in a w…

Hello graycat - I would be interested in a copy of your paper and/or the article name/publication date/etc. Regards

The same as for several others here at HN, leave your e-mail address in your HN profile, and I will try to remember to return, use your e-mail, and send you a PDF of the paper, 1999 in Information Sciences.
Post reply on HN