That can happen for a time. Investors might sit on things hoping that it will appreciate in value. However, many times there's a myth of "empty houses" used to justify not building more. Some people have cited non-owner-occupied condos as "empty" when they're merely rented. When a large new property comes on the market, often the owners take time selling off units so as not to flood the market and drive down their investment (just as one doesn't want to unload shares all at once and overwhelm demand). There's always a certain level of vacancies and a lot of the time when people think there are a lot of vacancies, it's not actually high. They just notice a couple fancy buildings that aren't full.
Prices are also sticky. If you bought a home at $X, you're going to psychologically want to get that back when selling. If you're a buyer, you've seen prices at X and you've become accustomed to thinking it costs that.
And a lot of people say that there's been a "massive housing boom" when production is a tiny fraction of historical levels. This can be understandable. If your area used to increase housing by 1% per year from 1920-2007 and then shrunk down to 0% per year from 2007-2015, increases of 0.5% per year might seem like a boom. However, it's below historical levels and might be coming after a near decade of under-creation. As such, there can be huge pent-up demand combined with a level of building that's still well below normal (but seems high compared to post-mortgage-crisis levels).
EDIT: https://twitter.com/TweetBenMax/status/1218712012114538497/p...
This isn't the best graph because housing production had already dropped off by the 90s, but it's still pretty clear. Everyone in expensive US cities thinks we're building lots of housing. However, when you look at it we're just not. Compared to the dip after the mortgage crisis, we're definitely building more. However, these expensive cities are also seeing historic levels of high-income job growth and migration towards them while having building at lower than historical levels. Maybe Australia is different, but it's probably just a comparison with post-mortgage-crisis lows and not actually a building boom. Even with new stock coming in, it can take years (think 5-15) to settle.