doesn't seem that crazy when you see someone doing this kind of stuff without computer assistance: http://www.youtube.com/watch?v=-zzhriAN9Bc
In this project they are using Vicon to determine the position of the quadrotor and the window. Once that information is processed, the quadrotor is properly controlled and has good enough "feedback", the human control can no longer be a match for the precision of a computer.