Live data from Hacker News

What happens when you run a CUDA kernel?

fergusfinn.com

31–36 of 36 posts

Re: What happens when you run a CUDA kernel?

#31
post #9

I just finished a master's on HPC where I had to take some classes on CUDA, MPI+CUDA, OpenCL. Reading an article like this before the classes would have been a lot helpful! Especially the part just before and after "What does it mean for a warp to be eligible?".

What university?

Re: What happens when you run a CUDA kernel?

#32
post #26

Earlier quoted context omitted.

How do you determine that the bugs you run into are located in the Nvidia drivers and libraries? Way back when I wrote the OpenCL driver at Qualcomm, we would frequently get bug reports from customers complaining about our code. During my tenure, every single one of them was root-caused as an application bug. Unsurprisingly, considering that our code was backed by an extensive test suite and their code wasn't. Not to…

I have never used Qualcomm's OpenCL driver, but it is not unknown to get the NVIDIA driver into a state where some kernel is stuck in a running state, or some memory is allocated long after the originating process has terminated. This is usually down to application bugs, sure - but no application bug should be able to wedge the driver. While developing GPU kernels, the code will certainly be buggy, and hence the driv…

I understand the frustration of these unmet expectations. There are good technical reasons why each of these things don't work the way you would like them to. E.g. adding preemption to GPUs is doable, but it is not cheap, and simply killing the task that is hogging the GPU is often the more practical and expeditious way to go.

Re: What happens when you run a CUDA kernel?

#33
Nice post. A note if the author is about, I had to use ublock origin to remove the header, as it hid text at the start of each page when printing. Firefox.

(I prefer to read longer articles on my e-ink device via epub or PDF)

Re: What happens when you run a CUDA kernel?

#34
post #9

I just finished a master's on HPC where I had to take some classes on CUDA, MPI+CUDA, OpenCL. Reading an article like this before the classes would have been a lot helpful! Especially the part just before and after "What does it mean for a warp to be eligible?".

What university?

It is a joint programme by Universities Santiago de Compostela and Coruña. I attended it from Barcelona, but they are in Galicia, Spain.

https://www.usc.gal/en/studies/masters/engineering-and-archi...

Re: What happens when you run a CUDA kernel?

#35

Earlier quoted context omitted.

shouldn't it be possible to be run as a mlautoresearch project? i.e. orchestrate 10 strategies to speed it up, run in paralellel, pick the winning and go from there?

You are assuming all problems in the world are solvable by one of "10 strategies".

He is not assuming that as he includes "and go from there."
Post reply on HN