I don't think a lot of people know what they want. There is just as much guessing as to which job to take as employers have choosing who to hire. Taking the most prestigious or most compensation is the safest bet, given that you don't really know what you want to do other than 'I like coding and interesting problems'. Partly I think that Harvard students have been adapted to seek prestige (else they probably wouldn't…
Exactly, everyone acts like there is some grand plan/design to all decision making. Everyone is just winging it.
A Relevant bit of reading, I think, I hope: https://fs.blog/2014/05/hunter-s-thompson-to-hume-logan/