Earlier quoted context omitted.
The issue with ‘driver in the loop only for emergencies’ is that it’s harder for someone to be prepared to react only occasionally (but still promptly and correctly) when outlier behavior happens, not easier. For automated tools like CNC machines, there is a reason it’s just ‘emergency stop’ for instance, not ‘tap the correct thing we should do instead’. But doing an e-stop on a road at speed is a very dangerous acti…
There's sort of an analogous conundrum with Airbus-style automation: the system has various levels of automation and protection (e.g. preventing you from stalling the plane) And then when something goes wrong, you are unceremoniously handed a plane with potentially some or all of those protections no longer active. As an analogy, imagine your FSD car was trying to slow down for something, but along the way there is s…
The level of training required to oversee full automation is non-trivial if you have to do more than press a stop button.