Obviously I'm talking about places that have both a real winter and a real summer. How well insulated your house is is primarily a function of the available technology and the cost of energy when it was built.
Probably the simplest reference I could give would be to point out that a lot of heavily populated places like Seattle, Chicago, the US Northeast, and much of Europe don't even install central air conditioning in homes at all. If we're talking about human survival standards of comfort, then obviously people have been living closer to the equator than you and I for a long time before AC was invented.
In the winter, often a furnace is used to burn gas or electricity in a pure "burning" of utility energy to heat. Some people have heat pumps which are more efficient, but when they hit their limits the backup furnace kicks in. Often additional water must be added to the inside air, and that must be heated as well. The temperature differential which must be maintained by the burning fuel is easily 40 deg F (say 28 to 68 on a mild day).
In the summertime, reasonable cooling involves using a refrigeration process to move heat out of the building. The refrigeration cycle isn't perfect, but it's surprisingly efficient since it's more moving the heat from one place to another. As a side effect, the inside air gets dehumidified which helps too. The summer cooling temperature difference is only 25 degrees F (say 98 to 75) on a hot day.