GPU Puzzles

#1

Post by cgadski » Wed, Sep 18, 2024, 1:08 PM UTC

Re: GPU Puzzles

#2

Post by xandrius » Mon, Sep 23, 2024, 11:36 AM UTC

Looks nice and fun but the "see-through" font for the titles in the screenshots gives me some deep and primordial unease, not sure why.

Re: GPU Puzzles

#3

Post by [deleted] » Mon, Sep 23, 2024, 12:01 PM UTC

[deleted]

Re: GPU Puzzles

#4

Post by srush » Mon, Sep 23, 2024, 12:20 PM UTC

I made these a couple of years ago as a teaching exercise for https://minitorch.github.io/. At the time the resources for doing anything on GPUs were pretty sparse and the NVidia docs were quite challenging.

These days there are great resources for going deep on this topic. The CUDA-mode org is particularly great, both their video series and PMPP reading groups.

Re: GPU Puzzles

#5

Post by fifilura » Mon, Sep 23, 2024, 12:59 PM UTC

xandrius wrote: post #2

Looks nice and fun but the "see-through" font for the titles in the screenshots gives me some deep and primordial unease, not sure why.

https://en.wikipedia.org/wiki/Astigmatism

Maybe?

Re: GPU Puzzles

#6

Post by [deleted] » Mon, Sep 23, 2024, 1:11 PM UTC

xandrius wrote: post #2

Looks nice and fun but the "see-through" font for the titles in the screenshots gives me some deep and primordial unease, not sure why.

[deleted]

Re: GPU Puzzles

#7

Post by bytepoet » Mon, Sep 23, 2024, 1:27 PM UTC

srush wrote: post #4

I made these a couple of years ago as a teaching exercise for https://minitorch.github.io/ . At the time the resources for doing anything on GPUs were pretty sparse and the NVidia docs were quite challenging. These days there are great resources for going deep on this topic. The CUDA-mode org is particularly great, both their video series and PMPP reading groups.

Thanks a lot, Sasha, for creating these. I found your LLM training puzzles to be excellent as well.