I thought it was strange that throughout is the same for CFP8 and BF16. Why support a fancy new 8 bit format if it's not faster than 16 bits? And there weren't any details about CFP8 so who knows what it really is.
Could be more efficient than BF16?
An inside look at the custom CPUs in Tesla's Dojo Supercomputer
51–60 of 132 posts
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#52Now assume that Moore's law stays healthy and in a few decades we're carrying around dojo-equivalent smart phones. Or implants. What do our apps do with all that compute? Detailed convincing AR, accurate real-time translation, identify almost any object in sight, turing-test passing answering machine. We'll be carrying around neural-net training hardware that is different than the stuff between our ears, often worse…
> What do our apps do with all that compute? Detailed convincing AR, accurate real-time translation, identify almost any object in sight, turing-test passing answering machine. We'll be carrying around neural-net training hardware
Or more likely they'll spend the compute power on the latest JavaScript framework....
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#53i cant stop thinking about the tesla bot. was he he outright lying? is it just a ploy to recruit robotics people? is it even plausible? i think the most challenging aspect of the idea is interacting with the world, picking up and handling various objects. its obvious from the presentation that fsd is very good at placing itself in space and mapping out its environment as well as devising routes even when accounting f…
More here: https://news.ycombinator.com/item?id=28241884 Sorry to point out but this has nothing to do with the article which is about semiconductors.
yes im aware. that thread is a day old and probably quite dead. i post here because i am interested to read peoples responses. and its certainly related since tesla bot will use fsd and be trained on the hardware discussed in the article.
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#54I find it surprising that google, amazon and now tesla can enter the « build your own processor » market that easily. Isn’t it more likely that they’re in fact only defining the general spec, and then use the services of other companies specialized in actually designing cpus ?
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#55Relevant cost breakdown from r/hardware: https://www.reddit.com/r/hardware/comments/p7tmuw/tesla_unve...
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#56I find it surprising that google, amazon and now tesla can enter the « build your own processor » market that easily. Isn’t it more likely that they’re in fact only defining the general spec, and then use the services of other companies specialized in actually designing cpus ?
Tesla hired people who designed chips for Apple and Intel to design their chips. They are designed from the ground up for this application. It seems like they're doing all the chip design in house.
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#57> If their claims are true, Tesla has 1 upped everyone in the AI hardware and software field. I’m skeptical, but this is also a hardware geek’s wet dream. How is the author declaring Tesla has one upped everyone in AI hardware and software while the article has exactly zero references to TPUs?
It's also a fictional product at this point. Even if the hardware existed, if you can't program it, it won't succeed.
In their presentation yesterday they made it clear that they have a full software stack for programming it. I don't know what is marketing hype and what is real, but they suggested it is very easy for them to program for it.
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#58Earlier quoted context omitted.
Moore’s law is quite dead. Transistor density isn’t doubling. We’re still getting speed increases due to architectural improvements, but transistor density is capping out because thermals are a problem. That’s why you see these massive wafer designs and they’re not shrinking.
> Transistor density isn’t doubling. It pretty much continues to double: https://en.m.wikipedia.org/wiki/Transistor_count#/media/File...
[deleted]
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#59> It appears the total tile is 15KW
> For those counting at home, there are 12 total tiles per cabinet
So 180kW per cabinet. I'd love to see what the cooling system looks like!
Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer
#60I thought it was strange that throughout is the same for CFP8 and BF16. Why support a fancy new 8 bit format if it's not faster than 16 bits? And there weren't any details about CFP8 so who knows what it really is.
Memory usage?