Being able to perform precise math in an LLM is important, glad to see this.
[flagged]
A CPU that runs entirely on GPU
21–30 of 144 posts
Re: A CPU that runs entirely on GPU
#22Why do we call them GPUs these days?
Most GPUs, sitting in racks in datacenters, aren't "processing graphics" anyhow.
Re: A CPU that runs entirely on GPU
#23Earlier quoted context omitted.
Based on addition and subtraction, 625000x slower or so than a 2.5ghz cpu
So it could run Doom?
Re: A CPU that runs entirely on GPU
#24I was taught years ago that MUL and ADD can be implemented in one or a few cycles. They can be the same complexity. What am I missing here?
Also, is it possible to use the GPU's ADD/MUL implementation? It is what a GPU does best.
Re: A CPU that runs entirely on GPU
#25Why do we call them GPUs these days? Most GPUs, sitting in racks in datacenters, aren't "processing graphics" anyhow.
General Processing Units
Gross-Parallelization Units
Generative Procedure Units
Gratuitously Profiteering Unscrupulously
Re: A CPU that runs entirely on GPU
#26Re: A CPU that runs entirely on GPU
#27Re: A CPU that runs entirely on GPU
#28A fun experiment but I wonder how many out there seriously think we could ever completely rid ourselves of the CPU. It seems to be a rising sentiment.
The cost of communicating information through space is dealt with in fundamentally different ways here. On the CPU it is addressed directly. The actual latency is minimized as much as possible, usually by predicting the future in various ways and keeping the spatial extent of each device (core complex) as small as possible. The GPU hides latency with massive parallelism. That's why we can put them across relatively slow networks and still see excellent performance.
Latency hiding cannot deal well in workloads that are branchy and serialized because you can only have one logical thread throughout. The CPU dominates this area because it doesn't cheat. It directly targets the objective. Making efficient, accurate control flow decisions tends to be more valuable than being able to process data in large volumes. It just happens that there are a few exceptions to this rule that are incredibly popular.
Re: A CPU that runs entirely on GPU
#29Re: A CPU that runs entirely on GPU
#30Why do we call them GPUs these days? Most GPUs, sitting in racks in datacenters, aren't "processing graphics" anyhow.
The dedicated term GPGPU [0] didn't catch on.
[0]: https://en.wikipedia.org/wiki/General-purpose_computing_on_g...