Tesla Dojo Custom AI Supercomputer at HC34 • Hacker News Board

Re: Tesla Dojo Custom AI Supercomputer at HC34

#21

Post by abledon » Wed, Aug 24, 2022, 6:51 AM UTC

killyourcar wrote: post #11

threatripper wrote: post #4

Earlier quoted context omitted.

Musk promising FSD by the end of the year - year after year - is one major thing that tarnished the Tesla image in my mind. I now assume that he has to believe that in order to avoid lawsuits. Maybe the same is with the computing infrastructure. They need to build it to show that they honestly believed it could work - even though they failed to deliver on their promises many times. That said, they do make progress an…

Musk is absolutely the reason I would never consider buying another Tesla, having just sold mine. Dude just straight up lies. He may not realize he's lying, but he lies constantly. Edit, because I'm getting downvoted. Here's some examples: self driving, battery swaps, robotic snake chargers, cybertruck windows, Bitcoin won't be converted to fiat, starlink speeds will improve, he will sell his home, first mars mission…

Curious... did you sell your Tesla because he lies? or for other issues? What replacement car/company did you decide to go with? Volkswagen?

Re: Tesla Dojo Custom AI Supercomputer at HC34

#22

Post by loser777 » Wed, Aug 24, 2022, 7:01 AM UTC

The most striking thing about the architecture is that it appears so heterogeneous and complex. Considering the vast amount of software/machine learning engineering behind model/data/pipeline parallelism schemes like Megatron-LM and ZeRO (which target hardware topologies that seem almost simple by comparison) I'm curious what abstractions are in place to make this beast of an architecture friendly to programmers. Can you program a small tile in the same way you would a large tile and like you would in CUDA for a large/small GPU? Are there dedicated kernel teams that implement common blocks like multiheaded attention with the topology in mind so researchers/engineers doing modeling don't have to worry about scaling the model architecture in a hardware-friendly way? Do they have a monstrous fork of PyTorch with "Dojo" supported natively?

Re: Tesla Dojo Custom AI Supercomputer at HC34

#23

Post by simonjgreen » Wed, Aug 24, 2022, 7:03 AM UTC

I wonder what the current owners of Tilera and their series of Tile processors think about Teslas naming here

Re: Tesla Dojo Custom AI Supercomputer at HC34

#24

Post by mg » Wed, Aug 24, 2022, 7:04 AM UTC

It's interesting to see to what extent matrix multiplication and backpropagation are dominating the AI space these days.

I wouldn't be surprised if other approaches like genetic programming will make a comeback one day.

If there are any papers out there arguing for/against neural networks to stay in the king's seat forever, I would love to see them.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#25

Post by cma » Wed, Aug 24, 2022, 7:04 AM UTC

killyourcar wrote: post #11

threatripper wrote: post #4

Earlier quoted context omitted.

Musk promising FSD by the end of the year - year after year - is one major thing that tarnished the Tesla image in my mind. I now assume that he has to believe that in order to avoid lawsuits. Maybe the same is with the computing infrastructure. They need to build it to show that they honestly believed it could work - even though they failed to deliver on their promises many times. That said, they do make progress an…

Musk is absolutely the reason I would never consider buying another Tesla, having just sold mine. Dude just straight up lies. He may not realize he's lying, but he lies constantly. Edit, because I'm getting downvoted. Here's some examples: self driving, battery swaps, robotic snake chargers, cybertruck windows, Bitcoin won't be converted to fiat, starlink speeds will improve, he will sell his home, first mars mission…

Dear Moon was supposed to be 2022. But he was supposed to land a manned dragon capsule on Mars in 2020 and before that 2018, plus passenger rocket flights from New York to Shanghai for between the price of a coach and business class ticket by 2028 (first made the claim in 2018, later doubled down on the 2028 date around 2020).

https://www.theverge.com/2017/2/17/14652026/spacex-red-drago...

Starlink satellites were supposed to have laser interlinks from the beginning and enable low latency multiplayer gaming around the world. The Starlink latency is pretty bad for gaming right now and is variable.

The battery swap stations were a bigger scam than you might remember: California gave them almost a billion for "delivering" them.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#26

Post by rvz » Wed, Aug 24, 2022, 7:23 AM UTC

killyourcar wrote: post #11

threatripper wrote: post #4

Earlier quoted context omitted.

Musk promising FSD by the end of the year - year after year - is one major thing that tarnished the Tesla image in my mind. I now assume that he has to believe that in order to avoid lawsuits. Maybe the same is with the computing infrastructure. They need to build it to show that they honestly believed it could work - even though they failed to deliver on their promises many times. That said, they do make progress an…

Musk is absolutely the reason I would never consider buying another Tesla, having just sold mine. Dude just straight up lies. He may not realize he's lying, but he lies constantly. Edit, because I'm getting downvoted. Here's some examples: self driving, battery swaps, robotic snake chargers, cybertruck windows, Bitcoin won't be converted to fiat, starlink speeds will improve, he will sell his home, first mars mission…

He is the modern day pied piper telling his devoted fans to buy his Fools Self Driving (FSD) contraption and gives lots of false promises so that he can keep the scam running and for his customers to keep believing his lies that it will be Level 5 'real soon'™ by these so-called 'updates'.

So far with this Fools Self Driving deception:

    Claim 1: 'Full Level 5 Autonomy by end of 2019' (2019) [0]
    Reality: As of this year 2022, it is still Level 2.

    Claim 2: '1 Million robo-taxis on the road by the end of 2020' (2019) [1] 
    Reality: As of this year 2022, ZERO Tesla robo-taxis on the road.

    Claim 3: 'Tesla's FSD tech will have Level 5 autonomy by the end of 2021' (2021) [2]
    Reality: As of this year 2022, it is admittedly Level 2.

    Claim 4: "I would be shocked if Tesla does not achieve FSD that is safer than human drivers this year" (2022) [3]
    Reality: Clearly it still isn't any safer 8 months ago. [4]

So even if we have given them more time since those claims in 2019, nothing has changed.

Not only it was admitted to be Level 2, [5] and still requires the full attention of the driver having their eyes on the road, they have ever continuously raised the prices on a system that clearly doesn't work as advertised in order to get customers to FOMO into purchasing it.

A complete scam of a contraption that can only be perfectly described as a 'Fools Self Driving' system.

[0] https://www.motortrend.com/news/tesla-autonomous-driving-lev...

[1] https://www.engadget.com/2019-04-22-tesla-elon-musk-self-dri...

[2] https://www.cnet.com/roadshow/news/elon-musk-full-self-drivi...

[3] https://electrek.co/2022/01/31/elon-musk-tesla-full-self-dri...

[4] https://news.ycombinator.com/item?id=32401444

[5] https://www.news18.com/news/auto/teslas-full-self-driving-cl...

Re: Tesla Dojo Custom AI Supercomputer at HC34

#27

Post by hoseja » Wed, Aug 24, 2022, 7:24 AM UTC

defrost wrote: post #18

killyourcar wrote: post #11

Earlier quoted context omitted.

Musk is absolutely the reason I would never consider buying another Tesla, having just sold mine. Dude just straight up lies. He may not realize he's lying, but he lies constantly. Edit, because I'm getting downvoted. Here's some examples: self driving, battery swaps, robotic snake chargers, cybertruck windows, Bitcoin won't be converted to fiat, starlink speeds will improve, he will sell his home, first mars mission…

Quoted post unavailable.

??? Why keep bringing that up? The sub wasn't needed because of fortunate good weather and less cave flooding than expected, the "advisor" who never even dived was a middle age white dude in SEA.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#28

Post by atdrummond » Wed, Aug 24, 2022, 7:47 AM UTC

hoseja wrote: post #27

defrost wrote: post #18

Earlier quoted context omitted.

Quoted post unavailable.

??? Why keep bringing that up? The sub wasn't needed because of fortunate good weather and less cave flooding than expected, the "advisor" who never even dived was a middle age white dude in SEA.

All of that is irrelevant to Musk calling the man a “pedophile” with zero evidence.

Re: Tesla Dojo Custom AI Supercomputer at HC34

#29

Post by 16890c » Wed, Aug 24, 2022, 7:53 AM UTC

hoseja wrote: post #27

defrost wrote: post #18

Earlier quoted context omitted.

Quoted post unavailable.

??? Why keep bringing that up? The sub wasn't needed because of fortunate good weather and less cave flooding than expected, the "advisor" who never even dived was a middle age white dude in SEA.

The sub was an insane idea by the account of all involved experts. Do you really think that being a middle aged white dude in SEA is enough to warrant pedophilia accusations?

Re: Tesla Dojo Custom AI Supercomputer at HC34

#30

Post by nielsinho » Wed, Aug 24, 2022, 8:00 AM UTC

mg wrote: post #24

It's interesting to see to what extent matrix multiplication and backpropagation are dominating the AI space these days. I wouldn't be surprised if other approaches like genetic programming will make a comeback one day. If there are any papers out there arguing for/against neural networks to stay in the king's seat forever, I would love to see them.

You can take a look here: https://youtu.be/27PYlj-qNb0