Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Linux 7.3 improves performance when running out of vRAM

pixelcluster.dev

Post reply on HN
Print view View original

291–300 of 328 posts

Re: Linux 7.3 improves performance when running out of vRAM

#291

Post by nomel »

Telaneo wrote: post #211
tcdent wrote: post #208

Earlier quoted context omitted.

Wait, how does literally no one in this thread mention swap? IME, many default installations in recent years don't configure swap by default. Dedicate a few tens-of-gigabytes on your hard drive and memory overflows there instead of borking.

It only postpones the inevitable. It doean't actually fix it. I went for a 64 GB swapfile to hopefully not have to worry about it any more, only to find my swapfile full after a few days anyway, even when configuring swappiness to a minimum. Shit just piles up for no apparent reason. I'm sure someone smarter than me can diagnose the problem, but I just decided to reduce the swapfile size to a more sensible value and…

"top" or maybe "slabtop" will find the offending, very very broken, program that's leaking memory like crazy, making your system doomed no matter what you do or how much physical memory you install.

Re: Linux 7.3 improves performance when running out of vRAM

#292

Post by inventor7777 »

frollogaston wrote: post #179
inventor7777 wrote: post #143

I see all the comments about how Windows and Linux handle OOM, but I suppose I'll also mention macOS. On my M4 Max Mac Studio if I try to load too big of an AI model with protections off, the desktop starts glitching back and forth between the past few hundred frames. It looks bad when it happens but CtrlC still works to kill llama.cpp and if you were using LM Studio, SSH also works. Once you kill the offending proce…

Heh, is it cause the integrated graphics is out of memory? Cause it's unified.

Oh, I never thought of that! That would be kind of funny if true.

Re: Linux 7.3 improves performance when running out of vRAM

#293

Post by to11mtm »

stillpointlab wrote: post #190
krisknez wrote: post #34

I hope there will be an update where when my RAM gets full my PC doesn't freeze and becomes unusable... I remember that Linux and Windows do this in different ways and Windows doesn't have the problem.

This gripe (that I literally crashed out on recently after maining Fedora for the first time) is top of my list for annoyance/frustration with Linux as a desktop. I now have btop permanently running in a Terminal and I habitually Alt-Tab to it to watch my swap. As soon as my free memory gets less than 1 Gb I kill any Firefox tabs (the memory black hole). I know this won't be popular, but Linux people have some kind o…

....

Well, As a bizarre counter thought...

My work PC, at least with all of the corporate fuckware installed...

I tend to see two behaviors when moving between work and home.

Either:

A - It won't go out of sleep, it basically forces a reboot.

Or,

B - It leaks memory that I can't free without a hard reboot, to where even copy-pasting becomes absolutely jank (my favorite nasty behavior; it double-processes paste operations, not fun when dealing with credentials...)

I do have 'local admin' and while I only checked a couple of times, both times it looked like even then I couldn't do a force kill/restart of whatever was jacking the thing up.

Meanwhile my wife's current 'my old' PC with the same amount of RAM as work laptop and probably lower/older CPU spec could last between forced windows updates without a reboot and a lot more general churn.

-----

If there's one reason I'm bringing this up, it's because I know my work PC has a lot more 'kernel' type management stuff installed...

And yeah, workplace people in charge of that stuff gives that same weird 'blame the user' focus as what you describe.

Re: Linux 7.3 improves performance when running out of vRAM

#294

Post by thereforegrin »

weinzierl wrote: post #228
stillpointlab wrote: post #218

Earlier quoted context omitted.

> how else do you expect it to work How does it work on Windows and MacOS where I don't get the same freezes and random programs aren't killed by the OS? Because I'd expect it to work like that. There is this false dichotomy, a black and white kind of thinking on display. > And I really doubt you mean to say that Windows is _more RAM efficient_ than Linux What I'm saying ought to be clear to anyone willing to listen.…

"How does it work on Windows[..]" This video from Mark Russinovich is a classic explaining it. It is old but still relevant. https://m.youtube.com/watch?v=AjTl53I_qzY&ra=m "My system should not get into an unrecoverable freezing state[..]" There is a good precedent for what you want: Safety critical embedded systems. Your car ECU should not be in an unrecoverable freezing state when you want to break. These embedded…

and killing programs and/or freezing the OS is somehow more efficient? By what metric? Certainly not by any UX or productivity one.

I've moved to Linux from Windows some years ago but the first thing that shocked me was precisely the abysmal performance around low memory availability.

Got my system stabilized eventually by means of some magical incantations but this wasn't a pleasant experience and I wouldn't want to repeat it.

It's beyond me how come Linux is so decrepid in this particular area compared to Windows.

Re: Linux 7.3 improves performance when running out of vRAM

#295

Post by thereforegrin »

trentnelson wrote: post #216
stillpointlab wrote: post #190

Earlier quoted context omitted.

This gripe (that I literally crashed out on recently after maining Fedora for the first time) is top of my list for annoyance/frustration with Linux as a desktop. I now have btop permanently running in a Terminal and I habitually Alt-Tab to it to watch my swap. As soon as my free memory gets less than 1 Gb I kill any Firefox tabs (the memory black hole). I know this won't be popular, but Linux people have some kind o…

Possibly an unpopular opinion on this forum, but virtual memory has always been one of the strengths of the NT kernel. (And integration between the cache manager, virtual memory manager, file system (NTFS), overlapped I/O, completion ports, and threading. It’s a very robust and performant foundation when leveraged correctly.)

doesn't Linux have virtual memory too? That would be retarded, though it would explain a lot.

Re: Linux 7.3 improves performance when running out of vRAM

#296

Post by efreak »

frollogaston wrote: post #177
sunaookami wrote: post #99

Earlier quoted context omitted.

Explorer freezes too when an external hard drive spins up, very annoying.

I remember my older Macs and Windows 98 laptops liked spinning the CD randomly, sometimes waiting to read it. I'd eject it when I hear it spinning. No CD for you.

I kept my floppy drive installed until I got tired of explorer freezing every time I accidentally selected it (quite often as I have a habit of navigating with the keyboard)

Re: Linux 7.3 improves performance when running out of vRAM

#298

Post by LoganDark »

inventor7777 wrote: post #290
LoganDark wrote: post #249

Earlier quoted context omitted.

Huh? I have 8TB of data I'd have to back up in order to downgrade macOS. You can't downgrade in-place.

Oh, I'm sorry. When you said "I don't have the spare 8TB" I assumed you were talking about GLM. Also, it's very rare for people to have the 8TB option on Macs - it's got to be a $1600+ option, huh? So not very common, which is why I assumed it meant something else.

I got the machine refurbished from Apple, so it was around $1k off. But yeah, my machine is 128GB/8TB.

Re: Linux 7.3 improves performance when running out of vRAM

#299

Post by dbmnt »

vladvasiliu wrote: post #70
alt227 wrote: post #44

Earlier quoted context omitted.

I personally am very excited for the upcoming Windows 11 update which will allow users to move the taskbar to any edge of their screen.

I don't use windows too often, but I remember I was happy with an update a year or two ago which allows changing the volume by scrolling on the tray icon. Now, of course, it still doesn't work with a touchpad, but baby steps, right?

OMG I didn't know about this. It works! Hover over the speaker icon and adjust with the mouse wheel.

Re: Linux 7.3 improves performance when running out of vRAM

#300

Post by dbmnt »

chongli wrote: post #52
noir_lord wrote: post #37

Earlier quoted context omitted.

Run (as Administrator) in a terminal reg.exe add "HKCU\Software\Classes\CLSID\{86ca1aa0-34aa-4e8b-a509-50c905bae2a2}\InprocServer32" /f /ve Should restore the old right click menu (it did last time I used it at any rate). So much of windows 11 configuration is removing things you never asked for and putting things back . Source: https://learn.microsoft.com/en-us/answers/questions/2287432/...

Sadly I’m in a locked down corporate environment, so I can’t edit the registry. IT even closed my ticket when I asked for them to make the edit on my behalf. I don’t use Windows on any personal machines, so there’s no way for this to benefit me. I hope it helps others who are frustrated by this though!

I hate what corporate IT has become. Hate.
Post reply on HN