This is a slight tangent...but does anybody know what UI toolkit Netflix is using for this? Or if it's in-house, any info on whether they have, or might release it? I see bootstrap-submenu.css mentioned, but not Bootstrap itself: https://github.com/Netflix/vector/tree/master/app/css
Introducing Vector: Netflix's On-Host Performance Monitoring Tool
41–50 of 64 posts
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#42It's enormously frustrating to me that the Windows platform is so far behind. I've been researching for a rebuild of our ecommerce site with the idea of a modern microservice architecture. Team skillset and some other considerations dictate a .Net environment. Netflix and other companies have created a really rich platform, between logging and monitoring technologies like this; message queueing; deployment; and so on…
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#43Not sure what the difference is between that and Collect + Graphite / InfluxDB.
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#44It's enormously frustrating to me that the Windows platform is so far behind. I've been researching for a rebuild of our ecommerce site with the idea of a modern microservice architecture. Team skillset and some other considerations dictate a .Net environment. Netflix and other companies have created a really rich platform, between logging and monitoring technologies like this; message queueing; deployment; and so on…
Not to be a dick but... that doesn't sound like a Windows limitation.
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#45Earlier quoted context omitted.
His concerns seem plain to me. Unauthenticated channels for software distribution or software installation instructions are bad. The techblog isn't using SSL, and the git pull url for PCP is using the git protocol which is also unauthenticated, rather than the authenticated https transport (ssh is only an option when user accounts make sense). Someone's at a conference and follows the link over public wifi. They get…
Ubuntu's maintainers can check the MD5SUM file on ftp.pcp.io: ftp://ftp.pcp.io/projects/pcp/download/MD5SUM The project seems to be hosted by Red Hat these days.
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#46It's enormously frustrating to me that the Windows platform is so far behind. I've been researching for a rebuild of our ecommerce site with the idea of a modern microservice architecture. Team skillset and some other considerations dictate a .Net environment. Netflix and other companies have created a really rich platform, between logging and monitoring technologies like this; message queueing; deployment; and so on…
In this one case the windows platform isn't going to hold you back too much. On top of that anything the .net stack on windows gives you access to WMI which can give you really simple really deep data from your application.
Don't buy into too much hype on what some of the big guys are doing on monitoring, most of their challenges seem to be around the scale they are monitoring at not with the depth of metrics.
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#47It's enormously frustrating to me that the Windows platform is so far behind. I've been researching for a rebuild of our ecommerce site with the idea of a modern microservice architecture. Team skillset and some other considerations dictate a .Net environment. Netflix and other companies have created a really rich platform, between logging and monitoring technologies like this; message queueing; deployment; and so on…
Have you looked at any of the following for the various gripes you mentioned? I came from a primarily Linux background until recently, but I know .net and Windows have good tooling that extends beyond my modest list below. Looking to Microsoft to provide every option is probably not the best way to go about it, not sure if that was mostly what you were looking at so far.
https://www.rabbitmq.com/install-windows.html (company I work for uses it for messaging between their services)
http://nlog-project.org/ (we also use that as a base framework for our logging)
http://getakka.net/ (never used it on .net but can't do without it in the jvm)
https://github.com/dotnet/Orleans (sort of like Akka, but with additional features)
https://github.com/MSOpenTech/Redis (it's a bit behind the nix version, but still well maintained)
https://msdn.microsoft.com/en-us/data/gg577609.aspx (Netflix uses the Java port of that, fyi)
https://technet.microsoft.com/en-us/sysinternals/bb896653.as...
http://en.wikipedia.org/wiki/Resource_Monitor
https://www.jetbrains.com/dotmemory/
https://www.jetbrains.com/profiler/
http://www.appveyor.com/ (great for CI and easy to set up)
https://www.cygwin.com/ (when you miss a nix shell and tools)
http://en.wikipedia.org/wiki/Windows_PowerShell (for everything cygwin can't do easily)
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#48It's enormously frustrating to me that the Windows platform is so far behind. I've been researching for a rebuild of our ecommerce site with the idea of a modern microservice architecture. Team skillset and some other considerations dictate a .Net environment. Netflix and other companies have created a really rich platform, between logging and monitoring technologies like this; message queueing; deployment; and so on…
So I haven't looked into all the metrics that they are getting off of PCP but from an initial glance it doesn't look like they are getting a lot more information then you get off net-snmp. In this one case the windows platform isn't going to hold you back too much. On top of that anything the .net stack on windows gives you access to WMI which can give you really simple really deep data from your application. Don't b…
One challenge is that there are some metrics that the kernel doesn't make available, so we need to either use tracers to fetch them, patch the kernel, or use custom kernel modules. In recent weeks, I've been using (or trying to use): ftrace, perf_events, SystemTap, eBPF, and LTTng. I've also used others, but not in the last few weeks. I'm really looking forward to getting these advanced tools into Vector.
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#49Anyone care to compare this to something like collectd? https://collectd.org/
Goal is a bit different. Vector doesn't collect and persist metrics. We needed something that had as little overhead as possible so it could be deployed to all our hosts and simplify the process of analyzing those metrics.
Re: Introducing Vector: Netflix's On-Host Performance Monitoring Tool
#50I got down to you should be able to install PCP from binary packages made available by the PCP development team on: ftp.pcp.io and that threw up a red flag in my brain. Then I noticed that techblog.netflix.com doesn't redirect to https (and indeed can't serve https) (I use https://www.eff.org/HTTPS-EVERYWHERE and did not get content over https). The directions _I_ saw for building from source looked pretty innocuous,…
Happy to discuss your concerns. PCP 3.10 should be available on Ubuntu's official repo pretty soon too.