Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Tesla Dojo Custom AI Supercomputer at HC34

servethehome.com

Post reply on HN
Print view View original

81–90 of 102 posts

Re: Tesla Dojo Custom AI Supercomputer at HC34

#81

Post by therouwboat »

dekhn wrote: post #73
pmorici wrote: post #45

Earlier quoted context omitted.

Pedophile was not the exact insult used why do you have it in quotes as if it were spoken verbatim?

You left out all the important details. No only did he say "pedo guy" specifically to implicate the guy as a pedophile, he hired a sketchy guy to investigate him. Also: """In emails to Buzzfeed News in September 2018, Musk also called him a "child rapist" and accused him of moving to Chiang Rai for a "child bride who was about 12 years old." He added that he "f---ing hope[d]" Unsworth would sue him. """ The person we…

I think most important part was that Elon tried to feed the child bride story to buzzfeed news "off the record". https://www.buzzfeednews.com/article/ryanmac/elon-musk-thai-...

Re: Tesla Dojo Custom AI Supercomputer at HC34

#82

Post by p_j_w »

killyourcar wrote: post #11
threatripper wrote: post #4

Earlier quoted context omitted.

Musk promising FSD by the end of the year - year after year - is one major thing that tarnished the Tesla image in my mind. I now assume that he has to believe that in order to avoid lawsuits. Maybe the same is with the computing infrastructure. They need to build it to show that they honestly believed it could work - even though they failed to deliver on their promises many times. That said, they do make progress an…

Musk is absolutely the reason I would never consider buying another Tesla, having just sold mine. Dude just straight up lies. He may not realize he's lying, but he lies constantly. Edit, because I'm getting downvoted. Here's some examples: self driving, battery swaps, robotic snake chargers, cybertruck windows, Bitcoin won't be converted to fiat, starlink speeds will improve, he will sell his home, first mars mission…

He lied about Hyperloop solely to convince CA to cancel HSR projects.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#83

Post by mistrial9 »

dekhn wrote: post #80
pclmulqdq wrote: post #40

Earlier quoted context omitted.

I'm not sure I would call the architecture very complex. It's about as simple as you can make a scale-out supercomputer. I assume they essentially do static positioning of the cluster for training jobs, and have a translation layer from the TensorFlow middle-end to their thing. Google did a similar thing with their TPUs, so it makes sense that they would have architected TF to accept exotic supercomputers as backends…

Tensorflow (and pytorch) convert your computation graph (constructed in python) to XLA, which is then specialized to a specific hardware architecture. XLA is a good intermediate language and in fact, you can convert some memory movement in the graph to network calls, allowing you to run on parallel systems (like a cluster of GPUs or TPUs with their own non-host-based networking). It still requires many experts, both…

> TF ended up being a bit of a pig with wings

Can you say more about this?

Re: Tesla Dojo Custom AI Supercomputer at HC34

#84

Post by sdfg413t »

I don't understand why they need this. Tesla has been selling fully-autonomous cars with L5 automation for years. They totally cracked self driving cars back in 2016, to the extent that "the person in the driver’s seat is only there for legal reasons", and have had 1,000,000 fully autonomous robotaxis on the road since 2020. What work remains to be done?

Still, it is good to see powerful hardware being put to good use for once. I understand it is silly to feel sorry for inanimate objects, but it saddens me to see silicon squandered by some manchild at a national lab working on a dead-end vanity project when it could be crunching numbers for Tesla or—better yet—mining Bitcoin.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#85

Post by dekhn »

mistrial9 wrote: post #83
dekhn wrote: post #80

Earlier quoted context omitted.

Tensorflow (and pytorch) convert your computation graph (constructed in python) to XLA, which is then specialized to a specific hardware architecture. XLA is a good intermediate language and in fact, you can convert some memory movement in the graph to network calls, allowing you to run on parallel systems (like a cluster of GPUs or TPUs with their own non-host-based networking). It still requires many experts, both…

> TF ended up being a bit of a pig with wings Can you say more about this?

Everybody at Google wanted to add their specific feature to TF (gets visibility, users, research cred). Unfortunately, many different teams added multiple incompatible features that didn't compose. TF1 also had some serious problems where it was fundamentally designed around C++, without an understanding that most people wanted to work in Python. With TF2 a lot of stuff got redesigned, making many examples on the web stop working. There are too m any ways to parallelize your computation (along any of the dimensions), and they change too frequently.

But I think the writing was on the wall when the folks building ML Pathways hit some performance problems and realized that Jax made it much, much easier for them to express the computations they wanted and see them run quickly on TPUs (DeepMind had also concluded this). Once Jeff saw that Jax was making stuff that ran faster than TF (for his pet projects) the writing was on the wall.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#86

Post by dragontamer »

mciancia wrote: post #43
dadof4 wrote: post #39

So they have one of the world’s most powerful super computers and they still can’t figure out how to make the car handle an incoming merge lane or how to properly drive down a two lane road without a lane lines…. I grew so frustrated with Tesla constantly trying to solve hard problems without mastering the easy stuff I sold the car.

Maybe it not an easy problem?

Maybe Tesla shouldn't be claiming it was solved in 2016, if it wasn't an easy problem.

The deadline for "Coast to Coast Full Self Driving" is over 5 years old now. https://techcrunch.com/2016/10/19/musk-targeting-coast-to-co...

Re: Tesla Dojo Custom AI Supercomputer at HC34

#87

Post by sdfg413t »

threatripper wrote: post #4
jeffbee wrote: post #2

They recycled a lot of material from last year's presentation. Tesla is the only company you really have to say this about: there is a non-negligible probability that this thing doesn't exist. There are no published results and we aren't seeing the mind-blowing pace of FSD improvements that Musk promised us in 2020 when Dojo 1.0 was only a year away.

Musk promising FSD by the end of the year - year after year - is one major thing that tarnished the Tesla image in my mind. I now assume that he has to believe that in order to avoid lawsuits. Maybe the same is with the computing infrastructure. They need to build it to show that they honestly believed it could work - even though they failed to deliver on their promises many times. That said, they do make progress an…

I don't see them making progress. They have gone backwards. A few years back, when they still used radar, they had a ho-hum suite of driver assistance features. Now they have nothing I would trust.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#88

Post by sdfg413t »

mlindner wrote: post #50
defrost wrote: post #18

Earlier quoted context omitted.

Quoted post unavailable.

> Never forget the cave rescue ready submarine and pedo accusations. I never forget that people like yourself continue to bring up the nonsense. He tried to help save the kids for goodness's sake. All he gets is ridicule for trying to help. You people are insufferable. Did no one ever teach you "don't look a gift horse in the mouth"?

>He tried to help save the kids for goodness's sake.

He tried, very loudly, to take over. He had absolutely no relevant knowledge or experience. He came in with a ridiculous solution that would kill everyone involved and refused to back off. When called on it, he responded with slander and harassment. With friends like this, who needs enemies?

For the record, I agree that he doesn't deserve ridicule. He deserves 50 years in prison. But that's for the FSD scam, not for the "pedo guy" incident.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#89

Post by sdfg413t »

rvz wrote: post #26
killyourcar wrote: post #11

Earlier quoted context omitted.

Musk is absolutely the reason I would never consider buying another Tesla, having just sold mine. Dude just straight up lies. He may not realize he's lying, but he lies constantly. Edit, because I'm getting downvoted. Here's some examples: self driving, battery swaps, robotic snake chargers, cybertruck windows, Bitcoin won't be converted to fiat, starlink speeds will improve, he will sell his home, first mars mission…

He is the modern day pied piper telling his devoted fans to buy his Fools Self Driving (FSD) contraption and gives lots of false promises so that he can keep the scam running and for his customers to keep believing his lies that it will be Level 5 'real soon'™ by these so-called 'updates'. So far with this Fools Self Driving deception: Claim 1: 'Full Level 5 Autonomy by end of 2019' (2019) [0] Reality: As of this yea…

Don't forget that Tesla released a doctored video clamining the problem was solved, past tense, all the way back in 2016.

I do not understand how they continue to get away with it.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#90

Post by dekhn »

mg wrote: post #24

It's interesting to see to what extent matrix multiplication and backpropagation are dominating the AI space these days. I wouldn't be surprised if other approaches like genetic programming will make a comeback one day. If there are any papers out there arguing for/against neural networks to stay in the king's seat forever, I would love to see them.

NNs only ended up working (at the level of human performance) because of 60+years of research punctuated by periods of very little interest (including times when GP/GA were being explored widely in the literature). And a bunch of that research was in entirely different areas, like GPUs, which went through many cycles of refinement for gaming and HPC before the DL people recognized its utility.

To achieve parity, GPs and GAs would need demonstrations on the level of what was seen about 10 years ago in NNs, then enough people would get involved to start doing more tech dev to make the hardware do GAs really, really, really fast.

Post reply on HN