Earlier quoted context omitted.
The codebase of an LLM is the size of a high school exam project. There is little to no coding in machine learning. That is the sole reason why they are overvalued - any company can write its own in a flash. You only require hardware to train and inference.
If it's so simple why does Chat GPT 4 perform better than almost everything else...
Parent's point is that GPT-4 is better because they invested more money (was that ~$60M?) in training infrastructure, not because their core logic is more advanced.
I'm not arguing for one or the other, just restating parent's point.