Live data from Hacker News

CUDA Tile Open Sourced

github.com

41–50 of 111 posts

Re: CUDA Tile Open Sourced

#41

Earlier quoted context omitted.

IMO it's not Nvidia's fault the competing APIs are high friction.

AMD screwed up so badly.

That is true, but that doesn't mean Nvidia is not engaging in engineering to intentionally kneecap competition. Triton and other languages like that are a huge threat and CUtile is a means to combat that threat and prevent a hardware abstraction layer.

Re: CUDA Tile Open Sourced

#42
post #24
post #10

Writing this in Mojo would have been so much easier

It would help if they were not so much macOS and Linux focused. Julia, Python GPU JITs work great on Windows, and many people only get Windows systems as default at work.

I've commissioned a board of MENSA members to devise a workaround for this issue; they've identified two potential solutions.

1) Install Linux

2) Summon Chris Lattner to play you a sad song on the world's smallest violin in honor of the Windows devs that refuse to install WSL.

Re: CUDA Tile Open Sourced

#43

Earlier quoted context omitted.

IMO it's not Nvidia's fault the competing APIs are high friction.

AMD screwed up so badly.

Hundreds of thousands of developers with access to a global communication network were not stopped by AMD. Why act like dependents or wait for some bright star of consensus unless the intent is really about getting the work for free?

We don't have to wait for singular companies or foundations to fix ecosystem problems. Only the means of coordination are needed. https://prizeforge.com isn't there yet, but it is already capable of bootstrapping its own development. Matching funds, joining the team, or contributing on MuTate will all make the ball pick up speed faster.

Re: CUDA Tile Open Sourced

#44
post #10

Writing this in Mojo would have been so much easier

Use-cases like this are why Mojo isn't used in production, ever. What does Nvidia gain from switching to a proprietary frontend for a compiler backend they're already using? It's a legal headache. Second-rate libraries like OpenCL had industry buy-in because they were open . They went through standards committees and cooperated with the rest of the industry (even Nvidia) to hear-out everyone's needs. Lattner gave up…

how mojo with max optimize the process?

Re: CUDA Tile Open Sourced

#45
post #30
post #11

Earlier quoted context omitted.

It's barely gaining adoption though. The lack of buzz is a chicken and egg issue for Mojo. I fiddled shortly with it (mainly to get it working some of my pythong scripts), and it was suprisingly easy. It'll shoot up one day for sure if Latner doesn't give up early on it.

Isn't the compiler still closed source? I and many other ML devs have no interest in a closed-source compiler. We have enough proprietary things from NVIDIA.

Yeah, the mojo pitch is so good, but I don't think anyone has an appetite for the potential fuckery that comes with a closed source platform.

Re: CUDA Tile Open Sourced

#46

Fun game: see how many clicks it takes you to learn what MLIR stands for. I lost count at five or six. Define your acronyms on first use, people.

GPU programming definitely is not beginner friendly. There's a much higher learning curve than most open source projects. To learn basic Python you need to know about definitions and loops and variables, but to learn CUDA kernels you need to know maybe an order of magnitude more concepts to write anything useful. It's just not worth the time to cater to people who don't RTFM, the README would be twice as long and be redundant to the target audience of the library.

Re: CUDA Tile Open Sourced

#47
post #30
post #11

Earlier quoted context omitted.

It's barely gaining adoption though. The lack of buzz is a chicken and egg issue for Mojo. I fiddled shortly with it (mainly to get it working some of my pythong scripts), and it was suprisingly easy. It'll shoot up one day for sure if Latner doesn't give up early on it.

Isn't the compiler still closed source? I and many other ML devs have no interest in a closed-source compiler. We have enough proprietary things from NVIDIA.

Yes, but Latner said multiple time it's closed until it matures (he apparently did this with llvm and swift too). So not unusal. His open source target is end of 2026. In all fairness, I have 0 doubts that he would deliver.

Re: CUDA Tile Open Sourced

#49
post #31

Earlier quoted context omitted.

Use-cases like this are why Mojo isn't used in production, ever. What does Nvidia gain from switching to a proprietary frontend for a compiler backend they're already using? It's a legal headache. Second-rate libraries like OpenCL had industry buy-in because they were open . They went through standards committees and cooperated with the rest of the industry (even Nvidia) to hear-out everyone's needs. Lattner gave up…

Kernels now written in Mojo were all in hand written in MLIR like in this repo. They made a full language because that's not scalable, a sane language is totally worth it. Nvidia will probably end up buying them in a few years.

Nobody is writing MLIR by hand, what are you on about? There are so many MLIR frontends

Re: CUDA Tile Open Sourced

#50
post #24
post #10

Writing this in Mojo would have been so much easier

It would help if they were not so much macOS and Linux focused. Julia, Python GPU JITs work great on Windows, and many people only get Windows systems as default at work.

Approximately nobody writing high performance code for AI training is using Windows. Why should they target it?
Post reply on HN