Carrying costs are important to this consideration. They shouldn't be significant compared to rent or the payment, but in some areas they are.
I fully agree that 50% of net worth in a home is too much. Though I doubt that the people you are thinking of actually have that much net worth in a house - the house might be worth that much, but odds are they only own 5-10% of it, and the rest is net worth of the bank. By the time your house is 50% yours you should have seen enough decrease in carrying costs - compared to inflation - that you have more investments elsewhere to pay it off.
The analysis of lost money vs investing needs to compared over a lifetime not a shorter span. Your payoff comes at the end when you need much less invested in the first place to pay for the rent you no longer owe at all. If God hasn't told you the future in detail you can't know: how much will inflation be, when will you die, and other such things that affect how your lifetime investments play out.
That last also gets into life goals. if your plan is to live cheap and work for the rest of your life to leave a large sum of money to your heirs that means a different investment strategy vs someone who wants to retire early and leave nothing behind when they die. For the latter there is a difference between someone who wants to retire and spend all their time in the shop building something vs someone who wants to retire and travel the world.
Only you know your life goals today (and you don't know how they might change in the future!) so you need to make the right decisions for your. Renting and buying a dwelling both have pros and cons so there is no right decision for everyone.