Show HN: Replacing my OS process scheduler with an LLM
1–10 of 43 posts
Re: Show HN: Replacing my OS process scheduler with an LLM
#2OP here. this is a cursed project lol, but i wanted to see: What happens if you replace the OS scheduler with an LLM?
With Groq speed (Llama 3 @ 800t/s), inference is finally fast enough to be in the system loop.
i built this TUI to monitor my process tree. instead of just showing CPU %, it checks the context (parent process, disk I/O) to decide if a process is compiling code or bloatware. It roasts, throttles, or kills based on that.
Its my experiment in "Intelligent Kernels" how they would be. i used Delta Caching to keep overhead low.
Re: Show HN: Replacing my OS process scheduler with an LLM
#3You can't replace the NTOS scheduler. This is more of an automated (?) process manager.
Re: Show HN: Replacing my OS process scheduler with an LLM
#4You can't replace the NTOS scheduler. This is more of an automated (?) process manager.
you are technically right (the best kind of right). i am running in userspace, so i cant replace the actual thread scheduling logic in Ring 0 without writing a driver and BSODing my machine.
think of this more as a High-Level Governor. The NTOS scheduler decides which thread runs next, but this LLM decides if that process deserves to exist at all.
basically; NTOS tries to be fair to every process. BrainKernel overrides that fairness with judgment. if i suspend a process, i have effectively vetoed the scheduler.
Re: Show HN: Replacing my OS process scheduler with an LLM
#5This is a pretty funny project, you've outsourced the neurotic developers that keep their task manager open and kill off processes they don't like.
I wouldn't call it replacing the scheduler though - more that you've made a scheduler manager.
Re: Show HN: Replacing my OS process scheduler with an LLM
#6You can't replace the NTOS scheduler. This is more of an automated (?) process manager.
you are technically right (the best kind of right). i am running in userspace, so i cant replace the actual thread scheduling logic in Ring 0 without writing a driver and BSODing my machine. think of this more as a High-Level Governor. The NTOS scheduler decides which thread runs next, but this LLM decides if that process deserves to exist at all. basically; NTOS tries to be fair to every process. BrainKernel overrid…
> NTOS tries to be fair to every process
This is a super simplification of the NTOS scheduler. It's not that dumb!
> if i suspend a process, i have effectively vetoed the scheduler.
I mean, I suppose? It's the NTOS scheduler doing the suspension. It's like changing the priority level -- sure, you can do it, but it's generally to your detriment outside of corner cases.
Re: Show HN: Replacing my OS process scheduler with an LLM
#7It really is cursed to be spending hundreds of watts of power in a datacenter somewhere to make a laptop run slightly faster.
Re: Show HN: Replacing my OS process scheduler with an LLM
#8This is a pretty funny project, you've outsourced the neurotic developers that keep their task manager open and kill off processes they don't like. I wouldn't call it replacing the scheduler though - more that you've made a scheduler manager.
I resemble that comment!
But seriously, it does really bug me on principle that DropBox should use over half a GB simply because it uses Chromium, even when nothing is visible.
Re: Show HN: Replacing my OS process scheduler with an LLM
#9It really is cursed to be spending hundreds of watts of power in a datacenter somewhere to make a laptop run slightly faster.
oh absolutely. burning a coal plant to decide if i should close discord is peak 2025 energy.
strictly speaking, using the local model (Ollama) is 'free' in terms of watts since my laptop is on anyway, but yeah, if the inefficiency is the art, I'm the artist.
Re: Show HN: Replacing my OS process scheduler with an LLM
#10This is a pretty funny project, you've outsourced the neurotic developers that keep their task manager open and kill off processes they don't like. I wouldn't call it replacing the scheduler though - more that you've made a scheduler manager.
haha exactly. i realized i spent too much time staring at htop wondering what is this process?, so i decided to automate my own anxiety.
Scheduler Manager is definitely the more accurate term. Im just the middleman between the chaos and the kernel.