Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Tesla's self driving algorithm's overlay [video]

tesla.com

Post reply on HN
Print view View original

431–440 of 658 posts

Re: Tesla's self driving algorithm's overlay [video]

#431

Post by grecy »

TaylorAlexander wrote: post #411
LeoPanthera wrote: post #354

Earlier quoted context omitted.

Tesla says their "Hardware 3", which is what you get if you buy it now, can process all cameras at 60fps.

I find it odd that they would publish a video showing performance numbers from out of date hardware. I mean I believe you - I watched the presentation in their custom processor and it’s quite impressive. Just weird that they’re showing old performance numbers. Perhaps this video is old.

There is speculation going around the "big rewrite" Elon mentioned last week is actually porting the code to run natively on the new hardware. Speculation says it's just been running in an emulation layer, but now they're about to unleash the full potential of the hardware.

If true, it makes sense the video would also have been captured using this emulation layer, explaining why it's not latest-and-greatest-fast.

Re: Tesla's self driving algorithm's overlay [video]

#433

Post by dheera »

0xff00ffee wrote: post #394
dylan604 wrote: post #2

I have often wondered about this, so I do find this interesting. Of all of the info presented, one question I have is how does the AI decide when to go at a 4-way stop? In real life, I'm am constantly amazed at how confusing a 4-way stop is to humans. Not that I ever had any doubt into how complicated real-time video analysis could be, this just makes my appreciation of the complexity of the problem that much more qu…

I've been driving for 40 years. I still hate 4-way stops. In the late 70's in Connecticut, I was taught the first person to arrive goes first, followed by the person to their right and so on. But there are so many holes with that heuristic itself! And putting aside guilt and anxieties of humans that prevent them from being assertive or committing--it's just a cluster fuck.* However, I have noticed that people are bec…

In California 4-way stops are often never marked "4-way" like in some other places. Whenever you come to a stop sign you have to inspect the crossing road to see whether or not it also has a stop sign. Often you stop and wait several seconds for a crossing car, only to realize that they also have a stop sign.

Re: Tesla's self driving algorithm's overlay [video]

#434

Post by grecy »

toufka wrote: post #142
phkahler wrote: post #135

Earlier quoted context omitted.

>> One issue not discussed enough is all this push for automation really needs road marking guidelines pushed down from the Federal level. That would be a mistake. You don't take a safety critical system and rely on a nationwide beauracracy getting all the details right to make it safe, or even effective. We've had the discussion here before, and the only way for full level 5 autonomy is a general AI capable of most…

Isn't that exactly what the federal government has done to extrodinary success with the interstate system? The interstates follow very strict and powerful standards that make us all so much safer. https://en.wikipedia.org/wiki/American_Association_of_State_...

I drove across the US 5 times in the summer of 2019, almost excursively on interstates (the 40, 70, 80 end to end).

I can assure you, there are hundreds of times that "strange" things happened to the road. Odd or incorrect lane markings, no lane markings, lanes beginning from the right and left, lanes ending suddenly on the right and the left, lanes marked as merge that were not, lanes not marked as merge that were, etc. etc. etc.

Every time I thought I could just stay in my lane with cruise set I found I was severely mistaken.

Re: Tesla's self driving algorithm's overlay [video]

#435

Post by coolspot »

akerro wrote: post #93

What are the blue squares? Features to estimate position and motion?

They seem to be points related to those shown as white road outline on right bottom quarter, also when a car drives across view at 0:24 it is marked by blue dots too, so it must be radar data for road boundaries and physical obstacles (like building wall at 0:15).

Re: Tesla's self driving algorithm's overlay [video]

#436

Post by trca »

thedance wrote: post #30

I wonder why they would let the public see this. To the critical eye it looks like it barely works. It loses its mind right at the beginning, around 0:06-0:07, veers to the right for no reason and then rolls through a stop sign without stopping. It spends the rest of the video hunting left and right like a drunk.

Karpathy (their Head of AI) showed how they are able to generate a 3D depth map of an environment given 2 forward-facing stereo cameras, it's possible that's what the car is attempting to do here since it recognizes that part of its vision will be blocked once it stops moving. Or it's trying to avoid the puddle lol.

Re: Tesla's self driving algorithm's overlay [video]

#437

Post by trca »

rootusrootus wrote: post #407
aeternum wrote: post #402

Earlier quoted context omitted.

Tesla's system is also doing much more than simple segmentation and visual odometry. Tesla's latency around actuating the control surface is quite insignificant (a few ms) so I'd argue it is a fair comparison.

Does it have the object permanence abilities of a six month old baby?

In the "FSD Preview" update that came out around Christmas time, the car now shows a bunch of symbols on the road, and signs (aka stop signs) that it recognizes. They don't flicker at all, even while you're driving and a large truck obscures the car's vision of the sign / stoplight. So they likely have started to enable some form of temporal memory into the system so that it remembers what it has observed in the environment both frame-to-frame and overall.

Re: Tesla's self driving algorithm's overlay [video]

#438

Post by jdc »

xkjkls wrote: post #299
nickik wrote: post #120

Earlier quoted context omitted.

Tesla and SpaceX, specially SpaceX has been rated very highly in some rating I have seen. But there is a reputation that it is a lot of work specially in crunch time.

https://www.glassdoor.com/Reviews/Tesla-Reviews-E43129.htm 3.3 is not a high review.

Space X is at 4.4 though

https://www.glassdoor.ca/Reviews/space-x-reviews-SRCH_KE0,7....

Re: Tesla's self driving algorithm's overlay [video]

#439

Post by Jamwinner »

starpilot wrote: post #199
felipemnoa wrote: post #183

Earlier quoted context omitted.

If done right it may even work against humans.

I think this is under-discussed. People bring up how self-driving cars can't deal with unwinnable situations, like crashing into a school bus vs. an old lady. Why is this scenario considered novel? Human drivers cannot avoid these either.

Because it hasent happened? The roadrunner gag comes up every few years only to be debunked (by snopes and others). Computer vision is fooled by many things that are still very obvious to the human observer.

Re: Tesla's self driving algorithm's overlay [video]

#440

Post by FatalLogic »

gimmeThaBeet wrote: post #159

I kind of giggle because the jittery-ness of some of the graphics makes it like I'm watching some robot version of Home Movies or Dr Katz. I bring that up because my hypothetical personal questions working on a system like this is 'smooth' decision making. Objects, lines, are jittery and falling in and out of recognition, but the actual control inputs to the car are smooth. I know, good conditions and all that, but I…

The raw sensory inputs to a human brain must also be jittery. Eyes apparently see highest definition detail only in a tiny area of the visual field, for example. The brain stitches it together, interpolates, tags features, and guesses. The preprocessing miraculously creates the impression of a big clear image out of a dirty data feed from two jello cameras that are swiveling around all the time. There's a lot a smoothing going on.

Imagine if you could see the raw input from an eye - it would be a big field of view, but mostly blurry, mostly not in full color, with a blind spot hole near the center, and the whole image jittering around violently.

One trait of practical real-world intelligence is ignoring 99.9% of everything. It usually works.

Post reply on HN