>We can sit and imagine problems with every course of action, and never step forward.
Well, you assume these are fake problems, and so the GP is being disingenuous.
The problems he mentions basically only happen if you stay at a computer, or such unphysical activities that form the basis of modern work.
As you properly notice, these problems are mostly nonexistent if you do "real" physical activities, but you can still suffer from them.
E.g. while doing inconsistent physical exercise in cold winters , your temperature will rise up a lot, so you may sweat a lot and then get cold fast again in your wet clothing.
Any construction worker knows this can be quite a hassle.
He then mention "cold hands". This is called "Raynaud syndrome", and affects 4% of people.
This is very difficult to deal with, especially if your primary work is typing at a computer.
There are many types of gloves you can buy: compression gloves, fishermen gloves, spandex ones, with 1 to 5 exposed fingers.
Each has particular downsides to deal with, none are perfect.
You can get silver-threaded clothing too, although that is quite expensive.
Managing good comfort while minimizing room-heating is not easy at all, and that does not even address other "house" issues (at an extreme, water-pipes exploding because of freezing water).