You want to waste VRAM, in this economy?
Use your Nvidia GPU's VRAM as swap space on Linux
11–20 of 142 posts
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#12I'm more interested in the opposite. Nvidia linux drivers crash when you try to address more VRAM than you have. It'd be nice if they didn't.
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#13RAM disks have always fascinated me. In a different timeline every PC has a 100gb of RAM and 50TB HDDs are the norm.
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#14use your car for an anchor on a big boat!
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#15I'm more interested in the opposite. Nvidia linux drivers crash when you try to address more VRAM than you have. It'd be nice if they didn't.
They already do that on windows and it kinda sucks. If you are targeting something like LMStudio or ComfyUI, both of those have superior methods to do exactly this.
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#16use your car for an anchor on a big boat!
I mean, if you aren’t using the car while using the boat and it won’t really damage the car… yes?
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#17Nice idea, but something has gone very wrong here:
>Sequential throughput: ~1.3 GB/s
[on a RTX 3070 Laptop]
This RTX 3070 chip is on PCIe 4.0 x16 which should give 64GB/s. The 8GB of GDDR6 is 448GB/s.
Swapping to an NVMe drive would be twice as fast, but with higher latency.
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#18Finally a use for the expensive ram when it's not needed in workloads!
Now if it could be dynamically used and vacated on other GPU workloads?
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#19No software benchmarks? BAR for RAM is cool but I want to see how much it _actually_ beats pcie nvme
Re: Use your Nvidia GPU's VRAM as swap space on Linux
#20Remember how 16GBs used to be an enterprise level database mainframe? Well, GPUs also have stupid amounts of compute on them. I have to imagine that there is some kind of database format that's useful with GPU compute attached. Since the data is already in VRAM, the GPU can sort, join, or otherwise manipulate data as needed.
Possibly LSM compaction.