You've described exactly how I feel. I've only be at this game for 4 years and I'm already looking for a way out. Programming is fun in the way that doing drugs is fun; it's addicting and provides a quick high, but at the cost of staring into a computer screen for weeks on end with little to no interaction with other people aside from meetings (which only exist so that your superiors can tell you which widget to crank out next).
I consider myself to be very introverted yet programming is still too extreme on the asocial end. A career in programming will gradually cause your social skills to atrophy. It's pretty obvious that if you spend 40+ hours a week talking to a computer that eventually you'll start to feel and act more robotic than your peers who regularly interact with real people in the real world.
Working as a programmer doesn't provide real human experiences. Everything that you do and learn as a programmer is extremely abstract (and usually convoluted). You won't have interesting stories and wise aphorisms to share your children and grandchildren, because everything you did was inside a virtual world.
Everything you build as a developer is extremely temporary. You will work extremely hard to build something over a period of months or even years, only for that software to be immediately discarded when the business pivots and decides to pursue a totally different path. If you work for a startup, you're hard work will be absolutely worthless if the business goes belly up. If you decide to contribute to open source software and build the next generation of frameworks, tools, and languages, prepare for that to work to go out of fashion within just a couple years. A construction worker can go back to a building he built 50 years ago and it will still be standing. A doctor or lawyer with 20+ years experience will be well respected, but as a developer your experience will be disregarded unless you're an expert in whatever framework/language is the flavor of the month.
Programming pays well and is a cushy office job. It doesn't provide much else.
EDIT: I fully expect people to reply with the usual "well that's just your opinion, man!". Yes. I know. This is a personal rant and not a master's thesis. If you love this career more power to you. I'm just sharing my opinion because I know other developers feel like I do, and feel trapped in a well paying but otherwise unfulfilling career.