Live data from Hacker News

CUDA Books

github.com

21–30 of 63 posts

Re: CUDA Books

#21

Having read or at least skimmed most of those books, I think the best intro is 'CUDA Programming: A Developer's Guide to Parallel Computing with GPUs' Massively Parallel Processors: A Hands-on Approach is not really good in my opinion, many small mistakes and confusing sentences (even when you know cuda). CUDA by Example: An Introduction to General-Purpose GPU Programming is too simple and abstract too much the archi…

the first book was published in 2012,is it too outdated?

Not really, Hardware didn't really change that much, of course you'll not find Tensor or raytracing cores, but you will have a very solid grasp of gpu programming and the cuda language (that didn't change that much either), and then you can easily learn those more modern things with blog posts or even, at worst, chatgpt.

Re: CUDA Books

#22

Having read or at least skimmed most of those books, I think the best intro is 'CUDA Programming: A Developer's Guide to Parallel Computing with GPUs' Massively Parallel Processors: A Hands-on Approach is not really good in my opinion, many small mistakes and confusing sentences (even when you know cuda). CUDA by Example: An Introduction to General-Purpose GPU Programming is too simple and abstract too much the archi…

I really wish there were better options to PMPP... It's by far the most up-to-date book, but I totally agree the writing is sort of bad and some of the code examples are straight up incorrect.

So tl;dr, you have at least one person who would pay for a better book :-)

Re: CUDA Books

#23
post #9

Increasingly (for instance ADSP podcast [1]) those in nvidia's inner circle are advocating against writing your own CUDA kernels. (Unless that's your full time job at nvidia, that is). [1] https://adspthepodcast.com/2024/08/30/Episode-197.html

can very much agree about not writing stuff like reductions yourself, unless you have good reason to. but this sort of feels like another "implement everything with and you'll have a great time!! (but also coincidentally get locked in even more to Nvidia hardware)"

Re: CUDA Books

#27
post #3

Earlier quoted context omitted.

It feels like a dirty secret, doesn't it?

Yeah, corps don't want you to know how to code, they want you to be a prompter...

Sometimes I squeeze in an hour or so a day to read. Living on the edge, looking for the next dopamine hit.

Re: CUDA Books

#28
I wish the README had a solid “what cool things you can do with this” right at the top.

In this day and age when programming is so accessible, why not have a more tempting pitch than just book titles categorized by difficulty.

Re: CUDA Books

#29
post #10

First one I clicked on is 404: Programming Massively Parallel Processors: A Hands-on Approach (3rd Edition) https://www.cambridge.org/core/books/programming-in-parallel...

the newest is 4th ed i think

A fifth edition has been out recently: https://shop.elsevier.com/books/programming-massively-parall...

I started learning about GPU and CUDA from this book recently, and I agree the writing is confusing, and code examples have errors. However, it is still a nice reference about many types of algorithms for heterogeneous memory devices, it helped me understand better some patterns for CPUs.

Re: CUDA Books

#30

Having read or at least skimmed most of those books, I think the best intro is 'CUDA Programming: A Developer's Guide to Parallel Computing with GPUs' Massively Parallel Processors: A Hands-on Approach is not really good in my opinion, many small mistakes and confusing sentences (even when you know cuda). CUDA by Example: An Introduction to General-Purpose GPU Programming is too simple and abstract too much the archi…

Very valuable comment. Thank you.

I always appreciate book lists like this one, but having a small targeted list is more practical for those of us with limited reading time.

Post reply on HN