Everyone charging at home in off-peak hours "fills in the bathtub" on energy usage charts. Peak demand during the day is huge, and it drops off substantially at night. We already have the power capacity to support every car switching magically tomorrow to EV so long as everyone agrees to charge in off-peak hours.
Yeah, there's absolutely no reason for chargers to be rare. In much of the world we have the electricity already spread amazingly wide. Every outside plug is already a potential Level 1 charger. You may frown at how slow Level 1 "trickle" charges, but think about how long most cars spend sitting somewhere, anywhere. Gain a few miles every time the car is parked. You can't put a gas station in every parking space, but you can certainly put a boring old fashioned three-prong plug there. (We have that technology. We've had it for like a century now.)
"Charging Stations" as a construct are certainly a convenience, especially when looking for reliable charging away from home, but chargers can be anywhere the (electric) light (bulb) touches (and that's a lot of the developed world). Thinking of chargers in traditional gas station terms is missing the opportunity, and confusing how the supply chain works. We don't need to centralize big reservoirs of "fuel" to maintain an EV fleet, we use the electric grid we've already spent a century building out, diversifying, and largely decentralizing.