Live data from Hacker News

Introducing Vector: Netflix's On-Host Performance Monitoring Tool

techblog.netflix.com

31–40 of 64 posts

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#31
post #15

Earlier quoted context omitted.

If its not collecting and persisting metrics, is it more of a glorified htop?

Wait, really? Why not? Storage is cheap. Do you use something else to get historical visibility into metrics?

I think the reason is they have a bunch of ephemeral hosts which they don't want to put in a central web interface or collect statistics on. They are only interested in getting some insight as to what went wrong with this host so they can fix it in the future.

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#32
post #15

Earlier quoted context omitted.

If its not collecting and persisting metrics, is it more of a glorified htop?

Wait, really? Why not? Storage is cheap. Do you use something else to get historical visibility into metrics?

Yes, Atlas, which is also open source: http://techblog.netflix.com/2014/12/introducing-atlas-netfli... . Atlas monitors cloud-wide, and stores historical metrics at a one minute granularity.

Vector is for per-instance custom drilldowns. I gave a talk last year where I showed how they both fit together: http://www.brendangregg.com/blog/2014-09-27/from-clouds-to-r...

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#33
post #15

Earlier quoted context omitted.

Wait, really? Why not? Storage is cheap. Do you use something else to get historical visibility into metrics?

Yes, Atlas, which is also open source: http://techblog.netflix.com/2014/12/introducing-atlas-netfli... . Atlas monitors cloud-wide, and stores historical metrics at a one minute granularity. Vector is for per-instance custom drilldowns. I gave a talk last year where I showed how they both fit together: http://www.brendangregg.com/blog/2014-09-27/from-clouds-to-r...

Got it... and thank you Brendan!

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#34
post #12
post #8

I got down to you should be able to install PCP from binary packages made available by the PCP development team on: ftp.pcp.io and that threw up a red flag in my brain. Then I noticed that techblog.netflix.com doesn't redirect to https (and indeed can't serve https) (I use https://www.eff.org/HTTPS-EVERYWHERE and did not get content over https). The directions _I_ saw for building from source looked pretty innocuous,…

Happy to discuss your concerns. PCP 3.10 should be available on Ubuntu's official repo pretty soon too.

His concerns seem plain to me. Unauthenticated channels for software distribution or software installation instructions are bad.

The techblog isn't using SSL, and the git pull url for PCP is using the git protocol which is also unauthenticated, rather than the authenticated https transport (ssh is only an option when user accounts make sense).

Someone's at a conference and follows the link over public wifi. They get the same page but with "here's how to get PCP: ftp evil.io or git clone git://git.evil.io/pcp" Even if the webpage were ssl-enabled so that an attacker can't rewrite the pcp.io links, an attacker or evil network operator could MITM git.pcp.io or ftp.pcp.io. (FTP?!)

Being in Ubuntu's repo doesn't make it safe if Ubuntu's maintainers have no (semi-)trustworthy way of getting the code.

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#36
I just tried installing this on a test VPS. PCP went well, but whenever I tried to input a "hostname" in Vector's UI to get stats, it just kept telling me it couldn't connect and to check hostname, regardless of what I put in the box. PCP was available and of course ports open and whatnot. I'm not sure what the problem was, but that was a bit frustrating. It looks like a slick product otherwise, especially for a first version! Thanks for releasing projects like this! I'll be trying again in the future, for sure.

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#37
This is a slight tangent...but does anybody know what UI toolkit Netflix is using for this?

Or if it's in-house, any info on whether they have, or might release it?

I see bootstrap-submenu.css mentioned, but not Bootstrap itself:

https://github.com/Netflix/vector/tree/master/app/css

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#38
After using Stackdriver for the last 18 months, I would never go back to rolling my own monitoring infra if I could avoid it. I had nagios, cacti, munin, graphite all running and had two ops guys pretty much 80% of their time managing it.

Stackdriver with pagerduty and I have 250,000 custom metrics being published and hundreds and hundreds of graphs on dozens of dashboards.

Although, I am looking at SignalFX to give even better version of this, but I manage nearly 1,000 machines with only a staff of four.

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#39

I just tried installing this on a test VPS. PCP went well, but whenever I tried to input a "hostname" in Vector's UI to get stats, it just kept telling me it couldn't connect and to check hostname, regardless of what I put in the box. PCP was available and of course ports open and whatnot. I'm not sure what the problem was, but that was a bit frustrating. It looks like a slick product otherwise, especially for a firs…

Can you open an issue on GitHub and post more details? Any errors on the JavaScript console?

Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool

#40
post #12

Earlier quoted context omitted.

Happy to discuss your concerns. PCP 3.10 should be available on Ubuntu's official repo pretty soon too.

His concerns seem plain to me. Unauthenticated channels for software distribution or software installation instructions are bad. The techblog isn't using SSL, and the git pull url for PCP is using the git protocol which is also unauthenticated, rather than the authenticated https transport (ssh is only an option when user accounts make sense). Someone's at a conference and follows the link over public wifi. They get…

Ubuntu's maintainers can check the MD5SUM file on ftp.pcp.io:

  ftp://ftp.pcp.io/projects/pcp/download/MD5SUM
The project seems to be hosted by Red Hat these days.
Post reply on HN