Earlier quoted context omitted.
I don't think CV ever will account for that. I always have thought the answer is going to be somewhere between great technology, and infrastructure to support it. We need "smart" roads.
Ultimately I think it'll have to be smart highways. You could embed a coded marker in the centre of each lane which the car can pick up using RF (e.g. an induction loop). This plus other constraints like GPS, visual-inertial odometry, etc should be enough to localise and remain safely within a lane boundary even if it's invisible. This would work fine through a layer of snow - some of the more expensive ski jackets h…
Since off-road use for smart cars is comparatively small, we should optimize the roads to be smart-car friendly.
Perhaps we could install systems which would enable smart cars to stay in lanes, perhaps with some hardware preventing the smart cars from going off-road.
And while we're there, we could also have systems providing charge built right into the road! Wouldn't that be neat?
The lane-keeping and power systems could allow regular cars to operate on the same roads, for backwards compatibility reasons.
Sounds too expensive to build? Not until you realize that you've re-invented the infrastructure for trams and trolleys put in place a 100 years ago.