Unless you're on the ProTour, choose riding comfort over rolling resistance. Also see https://www.renehersecycles.com/12-myths-in-cycling-1-wider-... for a related myth-debunking of the impact of tire width (which contributes to rolling resistance) on speed.
>Unless you're on the ProTour You don't have to be on the Pro Tour to benefit from aero gains with narrower tires. Even moderately fit people usually can sustain 15 mph on flat, at which point aero gains start to matter. Even more for hilly terrain where you can easily pick up over 20 mph on descents. The wider tires roll more efficient at lower psi (when you have to air down for comfort). But roughness of pavement r…
Speed on descents isn't really that relevant - you're descending, so unless you're racing it's practically effort-less. What matters for people biking normally (i.e., not recreational road bike racing) is assistance in the 10-15mph regime, on flat terrain or climbing.
Large changes in rolling resistance matters here, like going from an almost 40W tire to a 20W tire. But aerodynamics have a very minimal effect here, and going below 20W tires won't really make a meaningful difference in biking effort compared to the effect on your butt and wrists.