GpuScan and SSD-To-GPU Direct DMA
kaigai.hatenablog.com
GpuScan and SSD-To-GPU Direct DMA
1–10 of 28 posts
Re: GpuScan and SSD-To-GPU Direct DMA
#2So, if I understand correctly, data is being loaded directly from the SSD to the GPU and then filtered by the GPU before the CPU handles the more difficult queries.
Neat.
Re: GpuScan and SSD-To-GPU Direct DMA
#3Amazing results! We need more of that kind of thinking - GPU/SSD accelerate all the things!
Re: GpuScan and SSD-To-GPU Direct DMA
#4This is very interesting in the light of recent AMD announcement of their "Solid State Graphics", ie GPU with SSD ducktaped on: http://www.anandtech.com/show/10518/amd-announces-radeon-pro...
Re: GpuScan and SSD-To-GPU Direct DMA
#5This would be incredibly useful for distributed machine learning - imagine a Tensorflow implementation that almost entirely bypasses CPU.
Re: GpuScan and SSD-To-GPU Direct DMA
#6There is no explanation how it works. Does it work on top of existing APIs in user space? Or is there a custom kernel driver bypassing user space?
I've done some high throughput streaming from HD/SSD to GPU before, and it's pretty easy to beat the naive solution but getting the most out of it would require kernel space code.
I was doing random access streaming of textures using memory mapped files for input and copying to persistent/coherent mapped pixel buffers on the CPU with memcpy with background threads. This was intended to take advantage of the buffer caches (works great when a page is reused) and intended for random access. If I would have been working on a sequential/full file upload, my solution would be entirely different.
Edit: here's the source: https://github.com/kaigai/ssd2gpu
It has a custom kernel module.
Re: GpuScan and SSD-To-GPU Direct DMA
#7See also https://developer.nvidia.com/gpudirect and to some extent https://en.wikipedia.org/wiki/NVLink.
NVLink is in the Power9 servers Google is using.
Re: GpuScan and SSD-To-GPU Direct DMA
#8[deleted]
Re: GpuScan and SSD-To-GPU Direct DMA
#9See also https://developer.nvidia.com/gpudirect and to some extent https://en.wikipedia.org/wiki/NVLink . NVLink is in the Power9 servers Google is using.
AFAIK Intel is stonewalling NVLink on their CPUs so they can (try to) sell Knight's landing. Quite a shame, although it might hurt then in the long run if they drive more institutes to buy ARM plus Tesla or Power plus Tesla clusters.
Re: GpuScan and SSD-To-GPU Direct DMA
#10Who is providing the DMA engine in this case? Has the GPU access to PCIe device memory?