Nvidia adds native Python support to CUDA

I'm no GPU programmer, but seems easy to use even for someone like me. I pulled together a quick demo of using the GPU vs the CPU, based on what I could find (https://gist.github.com/victorb/452a55dbcf59b3cbf84efd8c3097...) which gave these results (after downloading 2.6GB of dependencies of course):

    Creating 100 random matrices of size 5000x5000 on CPU...
    Adding matrices using CPU...
    CPU matrix addition completed in 0.6541 seconds
    CPU result matrix shape: (5000, 5000)
    
    Creating 100 random matrices of size 5000x5000 on GPU...
    Adding matrices using GPU...
    GPU matrix addition completed in 0.1480 seconds
    GPU result matrix shape: (5000, 5000)

Definitely worth digging into more, as the API is really simple to use, at least for basic things like these. CUDA programming seems like a big chore without something higher level like this.

Re: Nvidia adds native Python support to CUDA

#6

Post by aixpert » Fri, Apr 04, 2025, 3:27 PM UTC

thank God, Pytorch gained so much momentum before this came out, Now we have a true platform independent semi standard For parallel computations. We are not stuck with NVIDIA specifics.

It's great that parts of pie torch which concern the NVIDIA backend can now be implemented in Python directly, The important part that it doesn't really matter or shouldn't matter for end users / Developers

that being said, maybe this new platform will extend the whole concept of on GPU computation via Python to even more domains like maybe games.

Imagine running rust the Game performantly mainly on the GPU via Python

Re: Nvidia adds native Python support to CUDA

#7

Post by [deleted] » Fri, Apr 04, 2025, 3:36 PM UTC

diggan wrote: post #5

I'm no GPU programmer, but seems easy to use even for someone like me. I pulled together a quick demo of using the GPU vs the CPU, based on what I could find ( https://gist.github.com/victorb/452a55dbcf59b3cbf84efd8c3097... ) which gave these results (after downloading 2.6GB of dependencies of course): Creating 100 random matrices of size 5000x5000 on CPU... Adding matrices using CPU... CPU matrix addition completed…

[deleted]

Re: Nvidia adds native Python support to CUDA

#8

Post by the__alchemist » Fri, Apr 04, 2025, 3:36 PM UTC

Rust support next? RN I am manually [de]serializing my data structures as byte arrays to/from the kernels. It would be nice to have truly shared data structures like CUDA gives you in C++!

Re: Nvidia adds native Python support to CUDA

#9

Post by pjmlp » Fri, Apr 04, 2025, 3:36 PM UTC

jbs789 wrote: post #2

Source?

The plethora of packages, including DSLs for compute and MLIR.

https://developer.nvidia.com/how-to-cuda-python

https://cupy.dev/

And

"Zero to Hero: Programming Nvidia Hopper Tensor Core with MLIR's NVGPU Dialect" from 2024 EuroLLVM.

https://www.youtube.com/watch?v=V3Q9IjsgXvA

Re: Nvidia adds native Python support to CUDA

#10

Post by rahimnathwani » Fri, Apr 04, 2025, 3:42 PM UTC

diggan wrote: post #5

I'm no GPU programmer, but seems easy to use even for someone like me. I pulled together a quick demo of using the GPU vs the CPU, based on what I could find ( https://gist.github.com/victorb/452a55dbcf59b3cbf84efd8c3097... ) which gave these results (after downloading 2.6GB of dependencies of course): Creating 100 random matrices of size 5000x5000 on CPU... Adding matrices using CPU... CPU matrix addition completed…

Thank you. I scrolled up and down the article hoping they included a code sample.