There's an underlying assumption that economical growth has anything to do with physical limits. Economical growth is a lie we tell ourselves so that innovation has its incentives, while everything else that's there because it must be there (because it will always have a demand), such as energy (but also food, real estate, etc.) just piggybacks with a similar 'fake growth' that really arises only from the fact these…
You started off right (i.e. it's not about material limits) but then I think you missed that material value can be created out of thin air.
As long as humans are innovating and improving their conditions, then 'growth' as we understand it continues.
The iPhone is not 'great' because of the amount of physical material we put into it.
The numbers we put growth it are a function of other, relative things, but the fact remains that value is being created.