31–40 of 132 posts
How is the author declaring Tesla has one upped everyone in AI hardware and software while the article has exactly zero references to TPUs?
I'm assuming this is a reference to the dojo scene in The Matrix.
> If their claims are true, Tesla has 1 upped everyone in the AI hardware and software field. I’m skeptical, but this is also a hardware geek’s wet dream. How is the author declaring Tesla has one upped everyone in AI hardware and software while the article has exactly zero references to TPUs?
Creating a lab beast is one thing, making it useful and economical in production is another.
Insane, truly insane. Meanwhile laptop CPUs, with the notable exception of M1, are impossible to cool.
Not sure that's relevant here - the reason they can cool this is because they're custom-designing housing, server racks, etc for these chips based on the amount of power they draw. You could cool pretty much anything if you were able to give it this much love and care.
> If their claims are true, Tesla has 1 upped everyone in the AI hardware and software field. I’m skeptical, but this is also a hardware geek’s wet dream. How is the author declaring Tesla has one upped everyone in AI hardware and software while the article has exactly zero references to TPUs?
- Communication speed is one of the biggest bottlenecks to large models, so their bandwidth of 4TBps is very smart.
- They claim a 1.3x perf/watt improvement, which is not really that great for ASICs compared to GPUs. Perf/watt is probably the most important number in datacenters.
- They only use SRAM, no DRAM. This is a huge mistake, which limits their model size. You can only fit a ~10GB model inside a single tile, versus 80GB models for a single A100 GPU.
- Software / compiler stack is as or more important than the hardware itself, because it dictates how much real performance you can squeeze out of the chips. I think Tesla will need to heavily focus on this area before getting anywhere close to real-world GPU performance.
Overall, I imagine the project will have similar pitfalls to Cerebras.
Taking everything at face value: Dojo is overall a very impressive project! - Communication speed is one of the biggest bottlenecks to large models, so their bandwidth of 4TBps is very smart. - They claim a 1.3x perf/watt improvement, which is not really that great for ASICs compared to GPUs. Perf/watt is probably the most important number in datacenters. - They only use SRAM, no DRAM. This is a huge mistake, which l…