Live data from Hacker News

CUDA Tile Open Sourced

github.com

51–60 of 111 posts

Re: CUDA Tile Open Sourced

#51
post #5

Will be interesting to see if Nvidia and other have any interest & energy getting this used by others, if there actually is an ecosystem forming around it. Google leading XLA & IREE, with awesome intermediate representations, used by lots of hardware platforms, and backing really excellent Jax & Pytorch implementations, having tools for layout & optinization folks can share: they really build an amazing community. Th…

For NVidia it suffices this is a Python JIT allowing programming CUDA compute kernels directly in Python instead of C++, yet another way how Intel and AMD, alongside Khronos APIs, lag behind in great developer experiences for GPU compute programming. Ah, and Nsight debugging also supports Python CUDA Tiles debugging. https://developer.nvidia.com/blog/simplify-gpu-programming-w...

Nsight does not have a debugger.

Re: CUDA Tile Open Sourced

#52
post #4

Will be interesting to see if Nvidia and other have any interest & energy getting this used by others, if there actually is an ecosystem forming around it. Google leading XLA & IREE, with awesome intermediate representations, used by lots of hardware platforms, and backing really excellent Jax & Pytorch implementations, having tools for layout & optinization folks can share: they really build an amazing community. Th…

> There's still so much room for planning/scheduling, so much hardware we have yet to target this is nicely illustrated by this recent article: https://news.ycombinator.com/item?id=46366998

Wrong type of scheduling.

Re: CUDA Tile Open Sourced

#53

Fun game: see how many clicks it takes you to learn what MLIR stands for. I lost count at five or six. Define your acronyms on first use, people.

This is a GitHub repo for compiler engineers.

Cool. This is a site for hackers of all stripes.

Re: CUDA Tile Open Sourced

#54
post #46

Fun game: see how many clicks it takes you to learn what MLIR stands for. I lost count at five or six. Define your acronyms on first use, people.

GPU programming definitely is not beginner friendly. There's a much higher learning curve than most open source projects. To learn basic Python you need to know about definitions and loops and variables, but to learn CUDA kernels you need to know maybe an order of magnitude more concepts to write anything useful. It's just not worth the time to cater to people who don't RTFM, the README would be twice as long and be…

That's the whole problem. I had to "R" multiple "FMs" before one of them bothered to define the acronym.

Stop carrying water for poor documentation practice.

Re: CUDA Tile Open Sourced

#56

Earlier quoted context omitted.

This is a GitHub repo for compiler engineers.

Cool. This is a site for hackers of all stripes.

Yes, so given that you clearly had trouble figuring out what it was, maybe you could have shared with the class?

Re: CUDA Tile Open Sourced

#57
post #46

Earlier quoted context omitted.

GPU programming definitely is not beginner friendly. There's a much higher learning curve than most open source projects. To learn basic Python you need to know about definitions and loops and variables, but to learn CUDA kernels you need to know maybe an order of magnitude more concepts to write anything useful. It's just not worth the time to cater to people who don't RTFM, the README would be twice as long and be…

That's the whole problem. I had to "R" multiple "FMs" before one of them bothered to define the acronym. Stop carrying water for poor documentation practice.

It's kind of like if the Django README explained how SQL works, the structure of HTTP requests, best practices for HTML, and so on. If you don't know what MLIR is, you might not be the target audience for this library. Nvidia in general doesn't prioritize developer experience as much as companies like Meta do for open source projects like React.

Re: CUDA Tile Open Sourced

#59

Will be interesting to see if Nvidia and other have any interest & energy getting this used by others, if there actually is an ecosystem forming around it. Google leading XLA & IREE, with awesome intermediate representations, used by lots of hardware platforms, and backing really excellent Jax & Pytorch implementations, having tools for layout & optinization folks can share: they really build an amazing community. Th…

> Google leading XLA & IREE

IREE hasn't been at G for >2 years.

Re: CUDA Tile Open Sourced

#60
post #58
post #10

Writing this in Mojo would have been so much easier

Mojo is not open source and would not get close to the performance of cuTile. I'm tired of people shilling things they don't understand.

it's all over this thread (and every single other hn thread about GPU/ML compilers) - people quoting random buzzword/clickbait takes.
Post reply on HN