Live data from Hacker News

Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

phoronix.com

171–180 of 407 posts

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#172
post #65

I'm struggling to understand what workloads Meta might be running that are _this_ latency-critical.

If you have 50,000 servers for your service, and you can reduce that by 1 percent, you save 50 servers. Multiply that by maybe $8k per server and you have saved $400k,you just paid for your self for a year. With meta the numbers are probably a bit bigger.

That's not how it works though. Budgets are annual. A 1% savings of cpu cycles doesn't show up anywhere, it's a rounding error. They don't have a guy that pulls the servers and sells them ahead of the projection. You bought them for 5 years and they're staying. 5 years from now, that 1% got eaten up by other shit.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#173

Valve is practically singlehandedly dragging the Linux ecosystem forward in areas that nobody else wanted to touch. They needed Windows games to run on Linux so we got massive Proton/Wine advancements. They needed better display output for the deck and we got HDR and VRR support in wayland. They also needed smoother frame pacing and we got a scheduler that Zuck is now using to run data centers. Its funny to think tha…

Next thing I want them to work on is Linux suspend(-to-RAM) support!

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#174
post #8

Earlier quoted context omitted.

I mean, part of it is that Linux's default scheduler is braindead by modern standards: https://en.wikipedia.org/wiki/Completely_Fair_Scheduler

CFS was replaced by EEVDF, no?

Ultimately, CPU schedulers are about choosing which attributes to weigh more heavily. See this[0] diagram from Github. EEVDF isn't a straight upgrade on CFS. Nor is LAVD over either.

Just traditionally, Linux schedulers have been rather esoteric to tune and by default they've been optimized for throughput and fairness over everything else. Good for workstations and servers, bad for everyone else.

[0]https://tinyurl.com/mw6uw9vh

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#175
post #126

Earlier quoted context omitted.

since when?

Since some of us could be bothered reading docs. Give it a try and see how it works out for you.

Some of us can! I certainly enjoy doing it, and according to "man 5 acl" what you assert is completely false. Unless you have a particular commit or document from kernel.org you had in mind?

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#176
post #65

Earlier quoted context omitted.

If you have 50,000 servers for your service, and you can reduce that by 1 percent, you save 50 servers. Multiply that by maybe $8k per server and you have saved $400k,you just paid for your self for a year. With meta the numbers are probably a bit bigger.

That's not how it works though. Budgets are annual. A 1% savings of cpu cycles doesn't show up anywhere, it's a rounding error. They don't have a guy that pulls the servers and sells them ahead of the projection. You bought them for 5 years and they're staying. 5 years from now, that 1% got eaten up by other shit.

You don't buy servers once every 5 years. I've done purchasing every quarter and forecasted a year out. You reduce your services budget for hardware by the amount saved for that year.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#177
post #64

Earlier quoted context omitted.

I was at Microsoft during the Windows 8 cycle. I remember hearing about a kernel feature I found interesting. Then I found linux had it for a few years at the time. I think the reality is that Linux is ahead on a lot of kernel stuff. More experimentation is happening.

I was surprised to hear that Windows just added native NVMe which Linux has had for many years. I wonder if Azure has been paying the SCSI emulation tax this whole time.

Afaik Azure is mostly Linux

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#178

Earlier quoted context omitted.

I was at Microsoft during the Windows 8 cycle. I remember hearing about a kernel feature I found interesting. Then I found linux had it for a few years at the time. I think the reality is that Linux is ahead on a lot of kernel stuff. More experimentation is happening.

Yeah and Linux is waaay behind in other areas. Windows had a secure attention sequence (ctrl-alt-del to login) for several decades now. Linux still doesn't.

Linux (well, more accurately, X11), has had a SAK for ages now, in the form of the CTRL+ALT+BACKSPACE that immediately kills X11, booting you back to the login screen.

I personally doubt SAK/SAS is a good security measure anyways. If you've got untrusted programs running on your machine, you're probably already pwn'd.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#179
post #65

Earlier quoted context omitted.

If you have 50,000 servers for your service, and you can reduce that by 1 percent, you save 50 servers. Multiply that by maybe $8k per server and you have saved $400k,you just paid for your self for a year. With meta the numbers are probably a bit bigger.

That's not how it works though. Budgets are annual. A 1% savings of cpu cycles doesn't show up anywhere, it's a rounding error. They don't have a guy that pulls the servers and sells them ahead of the projection. You bought them for 5 years and they're staying. 5 years from now, that 1% got eaten up by other shit.

You're wrong about how services that cost 9+ figures to run annually are budgeted. 1% CPU is absolutely massive and well measured and accounted for in these systems.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#180
post #49
post #31

Earlier quoted context omitted.

"It just works" sleep and hibernate. "Slide left or right" CPU and GPU underclocking.

“it just works” sleep was working, at least on basically every laptop I had the last 10 years… until the new s2idle stuff that Microsoft and Intel have foisted on the world (to update your laptop while sleeping… I guess?)

It never really worked in games even with S3 sleep. The new connected standby stuff created new issues but sleeping a laptop while gaming was a roulette wheel. SteamOS and the like actually work, like maybe 1/100 times I've run into an issue. Windows was 50/50.
Post reply on HN