Live data from Hacker News

A CPU that runs entirely on GPU

github.com

31–40 of 144 posts

Re: A CPU that runs entirely on GPU

#31
post #25

Why do we call them GPUs these days? Most GPUs, sitting in racks in datacenters, aren't "processing graphics" anyhow.

General Processing Units Gross-Parallelization Units Generative Procedure Units Gratuitously Profiteering Unscrupulously

Greed Processing Units

Re: A CPU that runs entirely on GPU

#34
post #28

A fun experiment but I wonder how many out there seriously think we could ever completely rid ourselves of the CPU. It seems to be a rising sentiment. The cost of communicating information through space is dealt with in fundamentally different ways here. On the CPU it is addressed directly. The actual latency is minimized as much as possible, usually by predicting the future in various ways and keeping the spatial ex…

I see us not getting rid of CPU, but CPU and GPU being eventually consolidated in one system of heterogeneous computing units.

Re: A CPU that runs entirely on GPU

#36

I was taught years ago that MUL and ADD can be implemented in one or a few cycles. They can be the same complexity. What am I missing here? Also, is it possible to use the GPU's ADD/MUL implementation? It is what a GPU does best.

To multiply two arbitrary numbers in a single cycle, you need to include dedicated hardware into your ALU, without it you have to combine several additions and logical shifts.

As to why not use the ADD/MUL capabilities of the GPU itself, I guess it wasn’t in the spirit of the challenge. ;)

Re: A CPU that runs entirely on GPU

#39
post #18
post #8

Earlier quoted context omitted.

> We need llms to be able to tap that not add the same functionality a layer above and MUCH less efficiently. Agents, tool-integrated reasoning, even chain of thought (limited, for some math) can address this.

You're both completely missing the point. It's important that an LLM be able to perform exact arithmetic reliably without a tool call. Of course the underlying hardware does so extremely rapidly, that's not the point.

The computer ALREADY does do math reliably. You are missing the point.
Post reply on HN