Sympathy upvote - not sure why you got downvoted for a perfectly cogent argument.
You are of course absolutely right - if what you're after is the resort hotel experience, jet-setting around the world, fine-dining and boutique shopping then yes, you do need to be exceedingly wealthy.
But IMHO travel is so much more meaningful than that, and in fact I don't see much of a point to the jet-set lifestyle at all. A trendy nightclub in Shanghai is going to be largely similar to a trendy nightclub in NYC; you will many of the same boutiques on a chic street in Paris as you would in London.
IMHO the point of travel is to experience the uniqueness a place has to offer - and to do so you cannot ignore the people who inhabit such a space. Largely, they are not rich and wealthy, and living the rich and wealthy jet-set lifestyle is essentially a barrier to meeting, interacting with, and getting to know them.
It is consistently surprising and disappointing to me that the upper classes in our society try so very hard to emulate the bohemian way of life, when it is so very easily in reach for just about everyone.