AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
1–10 of 26 posts
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#2We're two data center networking engineers who've spent years designing and operating data center infrastructure for governments, telcos and banks in West Africa. This piece came out of our work on a new AI architecture based on associative memory rather than transformers. The GPU-free argument here is something we think about the next phase of AI networking. Happy to discuss further about it.
PS: Taking a look at our manifesto (https://almartis.xyz/) can help with more context.
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#3We're two data center networking engineers who've spent years designing and operating data center infrastructure for governments, telcos and banks in West Africa. This piece came out of our work on a new AI architecture based on associative memory rather than transformers. The GPU-free argument here is something we think about the next phase of AI networking. Happy to discuss further about it. PS: Taking a look at ou…
Yes, read that. What these people are talking about seems to replacing training of NNs by something else entirely. The big question is, does that work? At all?
It's premature to discuss network architecture until that basic question is answered.
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#4The whole website is genuinely unreadable / illegible with poor contrast.
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#5The whole website is genuinely unreadable / illegible with poor contrast.
yes, they should increase the font size as a first step.
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#6The whole website is genuinely unreadable / illegible with poor contrast.
Looks like a font rendering or retina issue
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#7The whole website is genuinely unreadable / illegible with poor contrast.
This is the third time I've seen a website with this styling (serif, yellow and white on black). What's going on? Is it a template or some AI induced convergence?
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#8We're two data center networking engineers who've spent years designing and operating data center infrastructure for governments, telcos and banks in West Africa. This piece came out of our work on a new AI architecture based on associative memory rather than transformers. The GPU-free argument here is something we think about the next phase of AI networking. Happy to discuss further about it. PS: Taking a look at ou…
Very interesting of course, but stuff like this just needs a demo not a book. Can be super simple, but it needs to be demonstrated somehow.
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#9The whole website is genuinely unreadable / illegible with poor contrast.
This is the third time I've seen a website with this styling (serif, yellow and white on black). What's going on? Is it a template or some AI induced convergence?
Default output of claude code. Another obvious example is https://trumprx.gov/, with the background beige that's kinda close to the Hacker News one (to my eyes at least)
Re: AI Datacenters Were Built for GPUs. What Happens When You Remove the GPUs?
#10We're two data center networking engineers who've spent years designing and operating data center infrastructure for governments, telcos and banks in West Africa. This piece came out of our work on a new AI architecture based on associative memory rather than transformers. The GPU-free argument here is something we think about the next phase of AI networking. Happy to discuss further about it. PS: Taking a look at ou…
Yes, read that. What these people are talking about seems to replacing training of NNs by something else entirely. The big question is, does that work? At all? It's premature to discuss network architecture until that basic question is answered.
I'm maybe 10% of the way in but I find I'm increasingly skeptical. If the basic building block dates back to the 1970s haven't other people tried this by now? If not, isn't the first order of business to throw together a prototype that solves MINST or one of the many other small datasets floating around out there as a proof of concept?
So unfortunately I'm inclined to assume this is empty conjecture shat out by an LLM. Because who would write something up in this much detail rather than typing `import numpy as ...` and going to town?
I'll also note that the document has all the usual crank signs. Lots of grand visions, hypotheses, and expounding at an overly high level on how various things work with hardly anything concrete.