Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
1–10 of 149 posts
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#2Some simpler benchmark table would be great. May I suggest Ollama on base machine, Ollama with T1, Ollama with T1+T2 etc. on midsize and big models to compare token/sec?
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#3Would be great to get this into mainline Linux.
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#4Previously: https://news.ycombinator.com/item?id=47384557
(Still cool, still would benefit from better benchmarks)
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#5The is extremely slow and not useful in my opinion.
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#6The is extremely slow and not useful in my opinion.
I would say it depends entirely on your usecase. I don't think there can be a simple "not useful" generalization that applies to everyone.
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#7The is extremely slow and not useful in my opinion.
Can you elaborate beyond the shallow/superficial dismissal?
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#8This has been fun we can task our nemotron-3-super model to run over night when our desktops are idle. 4070s and 96gb of ram works fine. Slow but does it's job.
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#9The is extremely slow and not useful in my opinion.
I would say it depends entirely on your usecase. I don't think there can be a simple "not useful" generalization that applies to everyone.
Man I wish that was a canned response that could be deployed on demand! Well said.
I really appreciate thriftful & resourceful points of view. Exploring what if, looking for use is such a great virtue.
Re: Nvidia greenboost: transparently extend GPU VRAM using system RAM/NVMe
#10Related, a couple of years ago: https://old.reddit.com/r/Amd/comments/15t0lsm/i_turned_a_95_...
"I turned a $95 AMD APU into a 16GB VRAM GPU and it can run stable diffusion!"