For a counterpoint...I worked for a year, went to an elite college, got a degree, and I'm not sure I'd recommend it either. Yeah, I could probably get hired at Google if I wanted, but I
don't want to - and the rest of my resume isn't nearly as impressive as yours is.
If you're bright and independent-minded, the opportunity cost of that 4 years of college is huge. I did very little related to computers in those 4 years - I did get my degree in CS, and I worked on a large volunteer website, and I did a couple projects for my school, but I spent most of my time there as a physics major or trying out various liberal-arts classes. I graduated when I was 24. I have a friend that's 23, and he's currently maintaining 2 open source projects, formerly on another one (LiveJournal), has a good job in a specialized niche, previously had been a startup cofounder that went bust really quick, and has done webmonkey consulting for dozens of different organizations.
So I dunno. As you say, the problem is that it's impossible to tell ahead of time what you want out of life. When I was 20 and entering college, I sorta instinctively knew I wanted to be a startup software engineer (which is what I wanted at 19) yet told myself I wanted to be a theoretical physicist (which is what I wanted at 18) and went to a liberal arts school (which is what I wanted at 17). If it turns out you were wrong when you were young, then you thank your lucky stars that you went to that elite college and have many doors open before you. But if it turns out you were right, then you might be cursing yourself for the lost time spent hedging your bets instead of developing your specialty.
One other thing: doors do slam shut if you choose not to walk through them. I have friends who are in their late 20s or early 30s, straight-A alums of this elite college, and they've had a series of temp jobs because they couldn't decide what they wanted to do with their life. They're finding now that they're on the "no career" career. And while most of them are reasonably happy with their lives, they can't go back to the investment bank or biotech research lab or big software company that they turned down a job from upon graduation.