I hopped on a six or eight passenger tour plane operating from the grass field at Grand Marais Airport in Michigan around 1993. I was in the first row behind the pilot. There were high, gusty winds off Lake Superior and the pilot had to really work the yoke and throttle. It was almost athletic; the pilot was reacting to strong wind gusts -- big deflections of every control surface every second or two -- and yet the plane felt rock stable; if you had closed your eyes you could not have known there was this amazing pilot working it that hard. This went on from the moment he cleared the trees till just before touchdown. Really astonishing.
Around 2003 I took another flight in a Schweizer sailplane out of Boulder Municipal Airport in Colorado. I was amused by how the pilot somehow knew exactly where to find lift. He would deliberately fly along ridge lift, entering and exiting like there were signs in the sky; never a doubt where to find it even though the foothills were so far below there was no obvious correlation between the contours and the lift.
I think piloting is far removed from just about everything else. Non-pilots don't even suspect things that experienced pilots take for granted.