I just finished a master's on HPC where I had to take some classes on CUDA, MPI+CUDA, OpenCL. Reading an article like this before the classes would have been a lot helpful! Especially the part just before and after "What does it mean for a warp to be eligible?".
What happens when you run a CUDA kernel?
31–36 of 36 posts
Re: What happens when you run a CUDA kernel?
#32Earlier quoted context omitted.
How do you determine that the bugs you run into are located in the Nvidia drivers and libraries? Way back when I wrote the OpenCL driver at Qualcomm, we would frequently get bug reports from customers complaining about our code. During my tenure, every single one of them was root-caused as an application bug. Unsurprisingly, considering that our code was backed by an extensive test suite and their code wasn't. Not to…
I have never used Qualcomm's OpenCL driver, but it is not unknown to get the NVIDIA driver into a state where some kernel is stuck in a running state, or some memory is allocated long after the originating process has terminated. This is usually down to application bugs, sure - but no application bug should be able to wedge the driver. While developing GPU kernels, the code will certainly be buggy, and hence the driv…
Re: What happens when you run a CUDA kernel?
#33(I prefer to read longer articles on my e-ink device via epub or PDF)
Re: What happens when you run a CUDA kernel?
#34I just finished a master's on HPC where I had to take some classes on CUDA, MPI+CUDA, OpenCL. Reading an article like this before the classes would have been a lot helpful! Especially the part just before and after "What does it mean for a warp to be eligible?".
What university?
https://www.usc.gal/en/studies/masters/engineering-and-archi...
Re: What happens when you run a CUDA kernel?
#35Earlier quoted context omitted.
shouldn't it be possible to be run as a mlautoresearch project? i.e. orchestrate 10 strategies to speed it up, run in paralellel, pick the winning and go from there?
You are assuming all problems in the world are solvable by one of "10 strategies".