Doesn't it follow that if we all get rich, then things will be much worse?
But let's do another thought experiment: take everything from everybody. Clothing, housing, cars, infrastructure. If you also take away agriculture, the current population's numbers will starve, but not before foraging anything left. If you don't, then the environmental footprint of a naked and destitute human population in its current numbers will still be damning to the planet.
If you don't think any of this is accurate, take a look at the Middle East. Most of what once was the cradle of civilization because of its fertility is now cracked desert. And that happened way before the modern age. You can also go a little back in time, to the beginning of the Holocene, and see how humans had already managed to cause a great extinction.
Maybe there is a "middle way" where we enforce an acceptable level of wealth and well-being for each human being, and keep our demography in check, and we escape runaway greenhouse effect. It will be a regime that many today would find disagreeable (myself included), but some sacrifices must be made. And/or we start talking seriously about those rockets to move out of the planet....