Great post and I agree with you 100%. After playing around it and reading the theoretical aspect of how it works. There is an elephant in the room that should not be ignored.
The hype, more appropriately the cult following claims it will replace jobs and analogous to, second coming of Christ in the aspect of change the world. What it appears to me is there is massive money to be made. It as if, because how strong the hype is, it will drive future VC back startups to be make the next billions. My suggestion to you is, if you are in to make money, you will need to put the common sense part away and join the bandwagon.
I have same sentiment as you regarding LLM, but the biggest issue is that this sentiment will not make money. To make most of what is going on, is to fake the belief that this model will have a great affect on humanity and software solution that makes use of LLM needs funding till an IPO.