Earlier quoted context omitted.
I've found one good solution to this problem (for AC, at least): go for a car with a good "auto" mode! I hardly ever touch my AC, I just leave it on auto and the car does the rest to get it to the right temperature as quickly as possible. I suspect this is what most automakers think the real solution should be, just make it easy enough to set a temp and leave the rest to the computer.
That's a reasonable point. Too bad an auto mode for my music and podcasts (of varying volume; also varying with whether I have a passenger) is probably not a thing... On the other hand, my sense with how I use temperature control in my car is that most of my interactions are (a) set mode at start of driving (b) incrementally turn the temperature dial a notch or two without looking at it.
Sometimes, I do mash the defroster button when weather commands warm/dry air on the windshield and it's easy enough to find that with muscle memory.
Otherwise, in normal seasonal weather, it works well and I don't change modes or temperature. Windows up, down, hot, cold, sunny, cloudy, dark, whatever -- it all works about the same.
Previously, I drove an older version of the same vehicle. It also worked well until it forgot how to figure out what day it was due to a software issue. After that, it kind of had a mind of its own.
(Now, a sane person would ask why that would have to do anything to do with HVAC performance.
It gathered the current date, time, and position from GPS, the bearing from the nav's compass, and the solar intensity from a sensor on th dashboard.
A bit of math and/or an almanac lookup later, and it also knows the position and angle of the sun relative to the car.
So it knows when sunlight is streaming on through the driver's window, and adjusts automatically to compensate by providing relatively cool air from the dash vents only on that side. It also knows not to do this on a cloudy day as well as other things that seem obvious once a person starts thinking about them.
Which is a magical kind of automation -- until the calendar is off by both years and months because Honda broke the clock and its understanding of the sun broke with it: https://didhondafixtheclocks.com/ )