Why do we call them GPUs these days? Most GPUs, sitting in racks in datacenters, aren't "processing graphics" anyhow.
General Processing Units Gross-Parallelization Units Generative Procedure Units Gratuitously Profiteering Unscrupulously
A CPU that runs entirely on GPU
31–40 of 144 posts
Re: A CPU that runs entirely on GPU
#32Earlier quoted context omitted.
Yes: https://github.com/robertcprice/nCPU?tab=readme-ov-file#doom...
Can we run doom inside of doom yet?
Re: A CPU that runs entirely on GPU
#33Re: A CPU that runs entirely on GPU
#34A fun experiment but I wonder how many out there seriously think we could ever completely rid ourselves of the CPU. It seems to be a rising sentiment. The cost of communicating information through space is dealt with in fundamentally different ways here. On the CPU it is addressed directly. The actual latency is minimized as much as possible, usually by predicting the future in various ways and keeping the spatial ex…
Re: A CPU that runs entirely on GPU
#35Why do we call them GPUs these days? Most GPUs, sitting in racks in datacenters, aren't "processing graphics" anyhow.
CPU = Compute
GPU = ImputeRe: A CPU that runs entirely on GPU
#36I was taught years ago that MUL and ADD can be implemented in one or a few cycles. They can be the same complexity. What am I missing here? Also, is it possible to use the GPU's ADD/MUL implementation? It is what a GPU does best.
As to why not use the ADD/MUL capabilities of the GPU itself, I guess it wasn’t in the spirit of the challenge. ;)
Re: A CPU that runs entirely on GPU
#37As foretold six years ago. [1] [1]: https://breandan.net/2020/06/30/graph-computation#roadmap
Re: A CPU that runs entirely on GPU
#38Re: A CPU that runs entirely on GPU
#39Earlier quoted context omitted.
> We need llms to be able to tap that not add the same functionality a layer above and MUCH less efficiently. Agents, tool-integrated reasoning, even chain of thought (limited, for some math) can address this.
You're both completely missing the point. It's important that an LLM be able to perform exact arithmetic reliably without a tool call. Of course the underlying hardware does so extremely rapidly, that's not the point.