Street View is such a missed opportunity. In 2007 it was visionary and essential to create the map data that allowed Google Maps to win. In 2026 it is a symbol of Google's stagnation. Essentially zero improvement in user experience for more than a decade, in a time of incredible advancements in computer vision. By now we should all be flying around the planet in a seamless 3D reconstruction unifying street level and…
What you describe seems to have been implemented in Google Earth. It seems like an intentional product choice to do it in Google Earth and not Google Maps. Most people use Google Maps to get directions and reviews of places, and very few people I know even use the street view feature.
People rarely use the Street View feature because it's difficult to access, and difficult to understand spatially. Free camera motion is impossible and the transitions are jerky and stilted. As a result it's relegated to special places in the UI that are rarely visited. If it was seamlessly integrated into satellite view and directions then it would see much more usage.