Rivian's gambit for full autonomy

"You are right, that was a red light!"

At first I was skeptical, but reading the article, they do track object across video frames which for me it's the minimum a system like this should do. All previous FSD systems are just Fake self-driving.

"That proprietary AI driver identifies features in images and point clouds, groups them into objects, and tracks them across frames, time-stamped to the millisecond to account for differing frame rates. The AI thus builds confidence over time, acting on object detections that persist across several frames, rather than, say, slamming the brakes due to a camera blip on a single frame."

Isn't Tesla already there?

I took a fully-autonomyous Cybercab to a coffee shop yesterday; it doesn't even have a steering wheel. It was just a short drive, but it handled various complications (a garbage truck, double-parked cars, construction, unpainted speed bumps) with aplomb. The driving felt extremely smooth and human-like (better, in my experience, than Waymo, which can still be a bit jerky).

I don't like those headlights also. I think it's a case of when founders bring too much of their personality into the product. Otherwise great product and this self drive system at least has a sound start (track objects across video frames)

I was behind someone just the other week that was actively scrolling tiktok/reels while driving on a 3-lane road during rush hour with what appeared to be at least 2 kids in the back.

That's not really a useful comparison.

First, our current city driving environments were designed for being used by humans, so take into account human strengths and weaknesses.

Second, that kid has spent 16 years in such an environment learning how humans function there. He's got a very good model of how things work.

By the time I was 16 year old Timmy I'd spent a whole lot of time walking next to roads with cars, biking next to or in those roads with cars, and riding in cars on those roads. What was new when I was the driver was mostly learning the physics of cars and driving.

(I suppose nowadays, with the way parents can get in trouble letting kids out of their sight, we might have to worry about a generation of 16 year old Timmys who have not spent any significant time walking next to or biking next to or in roads with cars).

Third, that kid will have a pretty good model of predicting future behavior of other drivers, pedestrians, and cyclists based on figuring out their intent, which can even let them make some pretty good predictions about them even when they are hidden or masked from the kid's sensors.

Fourth, Timmy has a bunch of knowledge learned from listening to other people, reading, movies, etc., that can be applied while driving. For example suppose they live somewhere where there are many cows, but no deer. If they see a cow near the road at a place with no fence, they will have an appropriate model from experience that tells them cows are generally slow moving. Be cautious when passing, maybe giving it some extra space.

If the see a deer even though they have no experience with them they likely know that deer often bolt rapidly into the road right when a car gets close due to hearing stories from people who live in deer heavy regions or from news, books, or TV/movies, so go slow and be very cautious passing that.

Autonomous cars have a big advantage in reaction time, so if a bad situation starts to unfold they are likely better at saving the day than Timmy (or an experienced human driver) would be, but at least the systems so far deployed so far don't seem to be up to Timmy's understanding of other actors and their intent. They also seem unlikely currently to have that widespread non-driving knowledge that can be called upon to understand novel situation involving things that was not in their driver training.