There is a lot to unpack here, honestly.
Simple infrastructure is one of them. Many folks don't have safe options for bicycle transportation, regardless of whether you live in a city or not. Lack of sidewalks, lack of bike lanes, and lack of folks watching out for you. If you live outside a small town, you might have to take non-main roads and have a much longer commute as well.
Weather is an issue in some areas as well. While I can get studded snow tires for a bike here in Norway, I couldn't get them in Indiana. Not only are there these things, but employers frowned upon people arriving to work sweaty or wet (from rain). There were often no employee break rooms to change in, let alone a safe place to store one's bicycle or accessories while one is at work.
Another thing I'd like to point out is that the bicycles themselves were differently styled, at least judging what I saw in Amsterdam. Often, they had wide seats with springs and decently wide tires and a basket or two to hold your stuff. A bike built for comfort plus a place to put stuff helps tremendously.
This leads me to my final point: Distance. I imagine that you can reasonably travel to the grocery store and whatnot on a bicycle. Unfortunately, things are pretty spread out in much of the US. You might have to drive for 20 minutes to get to the grocery store because there aren't any near your house or on your way home from work. This takes much longer on a bicycle. If you do have convenience in this area, you are often paying more for it.