Actually, that steering into the oncoming train is just one of several severe instances in that video: * Almost driving right into a barrier because road is closed: https://youtu.be/yxX4tDkSc_g?t=426 * Choosing the wrong lane and getting confused: https://youtu.be/yxX4tDkSc_g?t=666 * Trying to run a red light, right into traffic: https://youtu.be/yxX4tDkSc_g?t=732 * Stopping in the middle of an intersection without r…
The issue with these AI systems is that the corner cases in the real-world can be fatal. Humans are pretty good, on the whole, at dealing with corner cases.
When an AI system learns it, the company can "teach" the entire fleet all at once.