Earlier quoted context omitted.
> Yet Tesla comes out saying “we’ve got some mediocre cameras and we’re gonna run with it!” To be fair, humans managed to solve self-driving with some mediocre cameras, some crappy microphones, and some unreliable force-feedback and chemical sensors, without (importantly) adding any new sensors to the hardware between start-of-project and successful full driving. So it's not a priori implausible that "use whatever se…
The difference here is that our “cameras” are processed in ways we really don’t understand and at speeds we can’t seem to compete with yet (at least not with the quality of processing we have, so far). Our sight is also enhanced by our hearing or familiarity with certain driving situations and, in most cases, familiarity with certain places we drive frequently. If we isolated our eyes from our other senses I have a f…
FSD needs the human sense that seeing a stop sign on the freeway (sticking out of the back of a highway maintenance trailer) doesn't mean what a stop sign usually means - but that stopped highway trailer, with a person holding the same sign and looking at you means you should follow it.
Should you run into a pile of gravel to avoid a baby stroller? If a loose garbage can and a baby stroller appear on opposite sides of the road and both block your path, which one do you hit? A soccer ball coming out between parked cars probably has a kid following it...
The people who have died with FSD ran into problems like these. A human would see a transport truck cab, and the wheels on the other side of the road and infer that - even though it blends into the sky - that there's a trailer in between. One of the Tesla accidents was that the side of the trailer appeared the same color and location as the sky, so the Tesla didn't see it and went under the trailer at highway speeds. The driver wasn't paying attention and didn't make it.
Sensing packages will only get you so far, human intuition for new unexpected situations is impossible to get AI to learn - at least at this point.