Earlier quoted context omitted.
It's not really free. It's free in the sense, that you can browse around, but if you wanted to do some analysis on it, you would need access to the raw bulk data, and this is very expensive. There is free aerial imagery data available (e.g. ESA's Sentinel-2), but it has lower resolution (10m/Pixel). If you want to do the 3D building thing, I estimate you need data with something like 1m/Pixel and from different persp…
San Francisco definitely has resolutions better than 1m/pixel it feels like (for buildings downtown) At least, you can clearly identify segments that would be < 1m across.
Furthermore most data is orthographic only, so you can built a nice 2D map out of it, but to do 3D I estimate you need images from specified angles (e.g. 4 views per place), and I think this data is still behind closed doors and quite expensive.