Live data from Hacker News

An inside look at the custom CPUs in Tesla's Dojo Supercomputer

semianalysis.com

101–110 of 132 posts

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#101
post #31

> If their claims are true, Tesla has 1 upped everyone in the AI hardware and software field. I’m skeptical, but this is also a hardware geek’s wet dream. How is the author declaring Tesla has one upped everyone in AI hardware and software while the article has exactly zero references to TPUs?

the how is: ML hype. Very few people can actually swim through the hype to the actual island, and in this case, the author isn't even capable of judging.

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#102
post #65

Earlier quoted context omitted.

Maybe they plan to get investors on "the hardware is great, it's only the software that has to be finished" just as with FSD.

to be honest FSD seems to be coming along albeit behind schedule. ive watched videos of the fsd beta and it is the closest thing ive ever seen to a car driving itself in an uncontrolled environment. i wonder what you make of dirty teslas latest driving video on youtube?

I find it some what odd that you don't consider Waymos taxi service to be in an uncontrolled environment. Yes, it is an incredible well mapped environment but so are the highways Tesla drive on.

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#103
post #88
post #13

Earlier quoted context omitted.

Even with reversible computing?

If we ever use reversible computing it won't look anything like this Tesla stuff, that's for sure.

Linear algebra is reversible if you nudge the matrixes so that the determinant is non-zero.

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#104

custom ISA, 400W TDP. Sounds like a real pain in the ass =)

As long as the ISA can get compiled for from Tensorflow, Torch or whatever DeepLearning AST is used geht's comppiled down to it the user won't notice unless he is optimizing his model for the hardware in which cases he would also have to care about the equivalent implementation details

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#105
post #32

I'm assuming this is a reference to the dojo scene in The Matrix.

Dojos have been used for training for a long time before The Matrix.

Yeah but it’s happening in a computer! Definitely feels like a The Matrix reference. Plus the whole thing is doing tons of matrix-based math.

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#106
post #87
post #75

The fact that they didn't do this: > Their current training cluster would be the 5th largest supercomputer if Tesla stopped all real workloads, ran Linpack, and submitted it to the Top500 list. which is trivial to do, and pretty much a must when bringing up the cluster to make sure its working properly, so much that most clusters do this on every maintainance, along with another bunch of benchmarks; and that they say…

There might be some level of showmanship involved, but Tesla isn't selling those things, it is using them. Quite a different situation in comparison to a random startup which tries to convince investors to finance their products.

I don't know, given Elon's showmanship, is it really that different?

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#107

i cant stop thinking about the tesla bot. was he he outright lying? is it just a ploy to recruit robotics people? is it even plausible? i think the most challenging aspect of the idea is interacting with the world, picking up and handling various objects. its obvious from the presentation that fsd is very good at placing itself in space and mapping out its environment as well as devising routes even when accounting f…

He does his little stunts/blunders, and he gets people talking. It's free advertising, and brand awareness.

Haha, don't know where the downvotes are coming from, this is the absolute truth right here.

He knows the world idolizes him as a slightly eccentric genius engineer with a heart of gold, and I think there's probably some truth in that, even. Nevertheless, if you are smart enough to be a good engineer, it doesn't take much to realize that you can greatly expand your aura by occasionally trolling people with something stupid just to see if you can get away with it. The fans will adore him more, the critics will pounce, but the net result is more exposure, and more exposure gets investment money. Rinse, repeat.

Personally, I think one of the smarter touches is to release/leak information that looks bad shortly before releasing information saying that the problem was overcome. This constantly reinforces the impression that anything Musk-related is always overcoming impossible odds. "Andrej didn't think we could do it, what do you think now, Andrej?" "The Starlink terminal costs $2400, but just a few months later, it costs $1000!"

I'm sure FSD will be here by Christmas.

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#108

Earlier quoted context omitted.

to be honest FSD seems to be coming along albeit behind schedule. ive watched videos of the fsd beta and it is the closest thing ive ever seen to a car driving itself in an uncontrolled environment. i wonder what you make of dirty teslas latest driving video on youtube?

I find it some what odd that you don't consider Waymos taxi service to be in an uncontrolled environment. Yes, it is an incredible well mapped environment but so are the highways Tesla drive on.

listen im trying to be objective about this but i cant help but point out that fsd is navigating crowded intersections, crowded downtown areas and roads without lane markers. ive seen videos of it

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#109
post #75

The fact that they didn't do this: > Their current training cluster would be the 5th largest supercomputer if Tesla stopped all real workloads, ran Linpack, and submitted it to the Top500 list. which is trivial to do, and pretty much a must when bringing up the cluster to make sure its working properly, so much that most clusters do this on every maintainance, along with another bunch of benchmarks; and that they say…

>trivial to do

>stopped all real workloads

Says you. Tesla don't need to be in the Top500 list to have a supercomputer that they are using for other more useful things.

Re: An inside look at the custom CPUs in Tesla's Dojo Supercomputer

#110
post #83

Earlier quoted context omitted.

You have never built a super computer, have you? You have to connect thousands of cables, have hundreds of nodes, with thousands of components, everything interconnected, and if you connect one wrong, the computer outputs incorrect results. You have to routinely update the software, and if a software upgrade introduces a 20% perf regression (which happens), then your 10 MWh cluster starts burning 2MWh for nothing. Or…

> run these benchmarks as an integration tests on every single cluster maintenance Why run someone else's benchmark and not your own application to test performance? And what's the point of submitting to Top500? Why do you care how your system ranks? What's the business or technical purpose in that?

Is this some sort of a post-truth joke?

If you are claiming something is the best, then without any comparable metrics across systems we are in the Twilight zone.

Post reply on HN