A CPU that runs entirely on GPU
github.com
A CPU that runs entirely on GPU
1–10 of 144 posts
Re: A CPU that runs entirely on GPU
#2Being able to perform precise math in an LLM is important, glad to see this.
Re: A CPU that runs entirely on GPU
#3Out of curiosity, how much slower is this than an actual CPU?
Re: A CPU that runs entirely on GPU
#4"Multiplication is 12x faster than addition..."
Wow. That's cool but what happens to the regular CPU?
Re: A CPU that runs entirely on GPU
#5Being able to perform precise math in an LLM is important, glad to see this.
Just want to point out this comment is highly ironic.
This is all a computer does :P
We need llms to be able to tap that not add the same functionality a layer above and MUCH less efficiently.
Re: A CPU that runs entirely on GPU
#6[deleted]
Re: A CPU that runs entirely on GPU
#7Out of curiosity, how much slower is this than an actual CPU?
Based on addition and subtraction, 625000x slower or so than a 2.5ghz cpu
Re: A CPU that runs entirely on GPU
#8Being able to perform precise math in an LLM is important, glad to see this.
Just want to point out this comment is highly ironic. This is all a computer does :P We need llms to be able to tap that not add the same functionality a layer above and MUCH less efficiently.
> We need llms to be able to tap that not add the same functionality a layer above and MUCH less efficiently.
Agents, tool-integrated reasoning, even chain of thought (limited, for some math) can address this.
Re: A CPU that runs entirely on GPU
#9Well GPU are just special purpous CPU.
Re: A CPU that runs entirely on GPU
#10As foretold six years ago. [1]
[1]: https://breandan.net/2020/06/30/graph-computation#roadmap