Tiny GPU: A minimal GPU implementation in Verilog
1–10 of 79 posts
Re: Tiny GPU: A minimal GPU implementation in Verilog
#2Really cool project I love seeing HW projects like this in the open. But I'd argue that this is a SIMD coprocessor. For something to be a GPU it should at least have some sort of display output.
I know the terminology has gotten quite loose in recent years with Nvidia & Co. selling server-only variants of their graphics architectures as GPUs, but the "graphics" part of GPU designs make up a significant part of the complexity, to this day.
Re: Tiny GPU: A minimal GPU implementation in Verilog
#3Yet another "GPU" providing no graphics functionality. IMO theses should be called something else.
Re: Tiny GPU: A minimal GPU implementation in Verilog
#4Yet another "GPU" providing no graphics functionality. IMO theses should be called something else.
I think the establishing term is AIA, AI Accelerator.
Re: Tiny GPU: A minimal GPU implementation in Verilog
#5Really awesome project. I want to get into FPGAs, but honestly it's even hard to grasp where to start and the whole field feels very intimidating.
My eventual goal would be to create acceleration card for LLMs (completely arbitrary), so a lot of same bits and pieces as in this project, probably except for memory offloading part to load bigger models.
Re: Tiny GPU: A minimal GPU implementation in Verilog
#6Yet another "GPU" providing no graphics functionality. IMO theses should be called something else.
I think the establishing term is AIA, AI Accelerator.
That would ignore applications like crypto mining, which I'm guessing is still a biggie.
What is it exactly that sets these units apart from CPUs? Something to do with the parallel nature of the hardware?
Re: Tiny GPU: A minimal GPU implementation in Verilog
#7Yet another "GPU" providing no graphics functionality. IMO theses should be called something else.
Easy, it's now a General Processing Unit. Or perhaps a Great Processing Unit?
Re: Tiny GPU: A minimal GPU implementation in Verilog
#8Re: Tiny GPU: A minimal GPU implementation in Verilog
#9Yet another "GPU" providing no graphics functionality. IMO theses should be called something else.
The first question is why is there a divide between CPUs and GPUs in the first place. Yes, the gap is closing and both categories are adding features of one another but there still is a significant divide. IMO it has to do with Amdahl's law [0]. In that sense CPUs should be called Latency-Optimizing-Processors (LOPs) and GPUs should be called Throughput-Optimizing-Processors (TOPs).
More specifically [1] we could also call CPUs long / deep data dependency processors (LDDPs) and GPUs wide / flat data dependency processors (WDDPs).
[0]: https://en.wikipedia.org/wiki/Amdahl%27s_law [1]: https://en.wikipedia.org/wiki/Data_dependency