So, it's 2018 - this was filmed 2008 on Solaris. Where is this UI for Linux? How can I reproduce the latency graphs in realtime on Linux?
99% sure it's this: https://docs.oracle.com/cd/E22471_01/html/821-0782/analytics...
Shouting in the Datacenter (2008) [video]
11–20 of 31 posts
Re: Shouting in the Datacenter (2008) [video]
#12tl;dr, Vibration due to shouting causes measurable impact on spinning disk performance, increasing io latency. I guess this wouldn't apply to SSD's though?
Are datacentres transitioning to SSDs ? Or have they already?
Most of the storage is and for quite some time will be magnetic until SSD costs lower enough. Also am not sure but I think for long term cold storage (backups, archives) magnetic can have advantages.
Re: Shouting in the Datacenter (2008) [video]
#13It seems almost common to break HDDs just while testing the firealarm. There are several incidents after a quick search. The latest big one was maybe this April in the Nasdaq's Scandinavian Data Center.
Re: Shouting in the Datacenter (2008) [video]
#14tl;dr, Vibration due to shouting causes measurable impact on spinning disk performance, increasing io latency. I guess this wouldn't apply to SSD's though?
Are datacentres transitioning to SSDs ? Or have they already?
The transition to various flash-based storage is essentially complete for anything that is inside the actual server (with booting the thing off SD card and that being the only storage inside being somewhat common), but for SAN systems SSDs aren't that much interesting, because the bottleneck is not in the storage media itself, but in the interconnect technology (typical SAN storage shelf can saturate it's FC ports on random IO traffic regardless of whether it is based on flash or spinning rust at 15k RPM)
Re: Shouting in the Datacenter (2008) [video]
#15So, it's 2018 - this was filmed 2008 on Solaris. Where is this UI for Linux? How can I reproduce the latency graphs in realtime on Linux?
There's this library with rudimentary histograms:
Re: Shouting in the Datacenter (2008) [video]
#16Ah, it's a classic. And wow, Brendan Gregg looks so young. And video uploaded by Bryan Cantrill himself. Damn it SUN had so many superstars yet it's Oracle that survived.
Re: Shouting in the Datacenter (2008) [video]
#17Ah, it's a classic. And wow, Brendan Gregg looks so young. And video uploaded by Bryan Cantrill himself. Damn it SUN had so many superstars yet it's Oracle that survived.
Brendan and Bryan in particular seem to be doing really well.
Brendan is senior performance architect at Netflix http://www.brendangregg.com/bio.html
Bryan is the CTO at Joyent, a cloud computing pioneer recently acquired by Samsung. https://www.joyent.com/about/management/bryan-cantrill
Re: Shouting in the Datacenter (2008) [video]
#18The making of video is arguably more interesting: https://youtu.be/lMPozJFC8g0
Re: Shouting in the Datacenter (2008) [video]
#19"Don't shout at your JBODs". Not something I'd ever considered, but good to know!
Re: Shouting in the Datacenter (2008) [video]
#20So, it's 2018 - this was filmed 2008 on Solaris. Where is this UI for Linux? How can I reproduce the latency graphs in realtime on Linux?
The UIs were part of Fishworks which became the ZFS Storage Appliance. A more fair question would be, why hasn't your storage appliance vendor (like Pure Storage, EMC or whatever) implemented the UIs (and maybe they have?).
As others point out dynamic tracing facilities should be there with bcc but to be honest you shouldn't even need dynamic tracing to create those graphs, just disk I/O queues, service time and throughput. I know how to get that easily on FreeBSD from libgeom(3), I'm sure it's not too hard on Linux either in one of the pseudo-filesystems.
[libgeom(3)] https://www.freebsd.org/cgi/man.cgi?query=libgeom&sektion=3