The technology is not the only problem. The lawyers that are defending every dead body, and there will be dead bodies, that will sink self-driving cars. Even if everyone is 95% safer with self-driving cars, those that are killed by a self-driving car (in combo with a public that is easily swayed with non-objective arguments) will be hard to dismiss.
I don't understand this. If there are 1/20th the amount of deaths, how is that going to sink self driving cars?
It's a different type of potential error and a much more scary one. I can mitigate human drivers as a pedestrian by taking care walking, but I cannot mitigate an AI that thinks my shirt makes me look invisible due to its learning being deceived by a pattern.