Live data from Hacker News

Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

phoronix.com

371–380 of 407 posts

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#371
post #351

Earlier quoted context omitted.

Do you have some resource for people outside this field to understand what it's about?

It goes all the way back to tapes, was still important for CDs, and still thought relevant for HDDs. Basically you can get much better read performance if you can read everything sequentially and you want to avoid random access at all costs. So you can basically "hydrate" the loading patterns for each state, storing the bytes in order as they're loaded from the game. The only point it makes things slower is once, on…

It's also a valid consideration in the context of streaming games -- making sure that all resources for the first scene/chapter are downloaded first allows the player to begin playing while the rest of the resources are still downloading.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#372
post #65

I'm struggling to understand what workloads Meta might be running that are _this_ latency-critical.

If you have 50,000 servers for your service, and you can reduce that by 1 percent, you save 50 servers. Multiply that by maybe $8k per server and you have saved $400k,you just paid for your self for a year. With meta the numbers are probably a bit bigger.

yes, but latency-optimized schedulers tend to have _worse_ throughput, not better.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#373
post #371
post #351

Earlier quoted context omitted.

It goes all the way back to tapes, was still important for CDs, and still thought relevant for HDDs. Basically you can get much better read performance if you can read everything sequentially and you want to avoid random access at all costs. So you can basically "hydrate" the loading patterns for each state, storing the bytes in order as they're loaded from the game. The only point it makes things slower is once, on…

It's also a valid consideration in the context of streaming games -- making sure that all resources for the first scene/chapter are downloaded first allows the player to begin playing while the rest of the resources are still downloading.

True!

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#374

Earlier quoted context omitted.

That's why the anti-GPL push is so harmful. Specially in the Rust ecosystem

There is absolutely nothing harmful about permissive licenses. Let's say that Wine was under the MIT license, and Valve started publishing a proprietary fork. The original is still there! Nobody is harmed by some proprietary fork existing, because nothing was taken away from them.

A decade or two ago Wine was on permissive license (MIT I think). When proprietary forks started appearing, Codewavers (which employs all the major Wine contributors) relicensed it as GPL.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#375

Earlier quoted context omitted.

Over time they're going to touch things that people were waiting for Microsoft to do for years. I don't have an example in mind at the moment, but it's a lot better to make the changes yourself than wait for OS or console manufacturer to take action.

I was at Microsoft during the Windows 8 cycle. I remember hearing about a kernel feature I found interesting. Then I found linux had it for a few years at the time. I think the reality is that Linux is ahead on a lot of kernel stuff. More experimentation is happening.

And behind in anything related to kernel security, sandboxing, user space drivers, and 3D graphics drivers.

Without Proton there would be no "Linux" games.

It would be great if Valve actually continued Loki Entertainment's work.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#376
post #168

Earlier quoted context omitted.

Procmon.exe. Give me 2 minutes. You make it sound like it's such a difficult thing to do. It literally will not take me more than 2 minutes to tell you exactly where the permission issue is and how to fix it.

Procmon won't show you every type of resource access. Even when it does, it won't tell you which entity in the resource chain caused the issue. And then you get security product who have the fun idea of removing privileges when a program creates a handle (I'm not joking, that's a thing some products do). So when you open a file with write access, and then try to write to the file, you end up with permission errors du…

Shitty security products being inscrutable isn't limited to Windows. "Disable SELinux" anyone?

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#377
post #134

Earlier quoted context omitted.

Over time they're going to touch things that people were waiting for Microsoft to do for years. I don't have an example in mind at the moment, but it's a lot better to make the changes yourself than wait for OS or console manufacturer to take action.

Tbh i'm starting to think that I do not see microsoft being able to keep it's position in the OS market ; with steam doing all the hard work and having a great market to play with ; the vast distributions to choose from, and most importantly how easy it has become to create an operating system from scratch - they not only lost all possible appeal, they seem stuck on really weird fetichism with their taskbar and just…

First Valve has to actually start pushing for proper Linux games, until then Windows can keep enjoying its 70% market share, with game studios using Windows business as usual.

Also Raspeberri PIs are the only GNU/Linux devices most people can find at retail stores.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#378
post #134

Earlier quoted context omitted.

Tbh i'm starting to think that I do not see microsoft being able to keep it's position in the OS market ; with steam doing all the hard work and having a great market to play with ; the vast distributions to choose from, and most importantly how easy it has become to create an operating system from scratch - they not only lost all possible appeal, they seem stuck on really weird fetichism with their taskbar and just…

> Tbh i'm starting to think that I do not see microsoft being able to keep it's position in the OS market It's a big space. Traditionally, Microsoft has held both the multimedia, gaming and lots of professional segments, but with Valve doing a large push into the two first and Microsoft not even giving it a half-hearted try, it might just be that corporate computers continue using Microsoft, people's home media equip…

Game developers still need Windows that Valve then runs on top of Proton.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#379

Earlier quoted context omitted.

I think that's the most likely way it'll go. Windows will remain as the default "enterprise desktop." It'll effectively become just another piece of business software, like an ERP. Gamers, devs, enthusiasts will end up on Linux and/or SteamOS via Valve hardware, creatives and personal users that still use a computer instead of their phone or tablet will land in Apple land.

With the massive adoption of web apps in Enterprise I have seen I would expect Windows to become irelevant or even a liability in business use as well.

My employer only does either Windows or macOS, Linux place is on servers for us.

Re: Meta is using the Linux scheduler designed for Valve's Steam Deck on its servers

#380

Valve is practically singlehandedly dragging the Linux ecosystem forward in areas that nobody else wanted to touch. They needed Windows games to run on Linux so we got massive Proton/Wine advancements. They needed better display output for the deck and we got HDR and VRR support in wayland. They also needed smoother frame pacing and we got a scheduler that Zuck is now using to run data centers. Its funny to think tha…

Game development is STILL a highly underrated field. Plenty of advancements/optimizations (both in software/hardware) can be directly traced back to game development. Hopefully, with RAM prices shooting up the way it is, we go back to keeping optimizations front and center and reduce all the bloat that has accumulated industry wide.

I think one could even say gaming as a sector single handedly move most of the personal computing platform forward since 80s and 90s. Before that it was probably Military and cooperate. From DOS era, overclocking CPU to push benchmarks, DOOM, 3D Graphics API from 3DFx Glide to Direct X. Faster HDD for faster Gaming Load times. And for 10 - 15 years it was gaming that carried CUDA forward.
Post reply on HN