Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
171–180 of 407 posts
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#172I'm struggling to understand what workloads Meta might be running that are _this_ latency-critical.
If you have 50,000 servers for your service, and you can reduce that by 1 percent, you save 50 servers. Multiply that by maybe $8k per server and you have saved $400k,you just paid for your self for a year. With meta the numbers are probably a bit bigger.
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#173Valve is practically singlehandedly dragging the Linux ecosystem forward in areas that nobody else wanted to touch. They needed Windows games to run on Linux so we got massive Proton/Wine advancements. They needed better display output for the deck and we got HDR and VRR support in wayland. They also needed smoother frame pacing and we got a scheduler that Zuck is now using to run data centers. Its funny to think tha…
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#174Earlier quoted context omitted.
I mean, part of it is that Linux's default scheduler is braindead by modern standards: https://en.wikipedia.org/wiki/Completely_Fair_Scheduler
CFS was replaced by EEVDF, no?
Just traditionally, Linux schedulers have been rather esoteric to tune and by default they've been optimized for throughput and fairness over everything else. Good for workstations and servers, bad for everyone else.
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#175Earlier quoted context omitted.
since when?
Since some of us could be bothered reading docs. Give it a try and see how it works out for you.
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#176Earlier quoted context omitted.
If you have 50,000 servers for your service, and you can reduce that by 1 percent, you save 50 servers. Multiply that by maybe $8k per server and you have saved $400k,you just paid for your self for a year. With meta the numbers are probably a bit bigger.
That's not how it works though. Budgets are annual. A 1% savings of cpu cycles doesn't show up anywhere, it's a rounding error. They don't have a guy that pulls the servers and sells them ahead of the projection. You bought them for 5 years and they're staying. 5 years from now, that 1% got eaten up by other shit.
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#177Earlier quoted context omitted.
I was at Microsoft during the Windows 8 cycle. I remember hearing about a kernel feature I found interesting. Then I found linux had it for a few years at the time. I think the reality is that Linux is ahead on a lot of kernel stuff. More experimentation is happening.
I was surprised to hear that Windows just added native NVMe which Linux has had for many years. I wonder if Azure has been paying the SCSI emulation tax this whole time.
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#178Earlier quoted context omitted.
I was at Microsoft during the Windows 8 cycle. I remember hearing about a kernel feature I found interesting. Then I found linux had it for a few years at the time. I think the reality is that Linux is ahead on a lot of kernel stuff. More experimentation is happening.
Yeah and Linux is waaay behind in other areas. Windows had a secure attention sequence (ctrl-alt-del to login) for several decades now. Linux still doesn't.
I personally doubt SAK/SAS is a good security measure anyways. If you've got untrusted programs running on your machine, you're probably already pwn'd.
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#179Earlier quoted context omitted.
If you have 50,000 servers for your service, and you can reduce that by 1 percent, you save 50 servers. Multiply that by maybe $8k per server and you have saved $400k,you just paid for your self for a year. With meta the numbers are probably a bit bigger.
That's not how it works though. Budgets are annual. A 1% savings of cpu cycles doesn't show up anywhere, it's a rounding error. They don't have a guy that pulls the servers and sells them ahead of the projection. You bought them for 5 years and they're staying. 5 years from now, that 1% got eaten up by other shit.
Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers
#180Earlier quoted context omitted.
"It just works" sleep and hibernate. "Slide left or right" CPU and GPU underclocking.
“it just works” sleep was working, at least on basically every laptop I had the last 10 years… until the new s2idle stuff that Microsoft and Intel have foisted on the world (to update your laptop while sleeping… I guess?)