Can someone provide insight into why there's so much insistence from business that magic happens at scale with LLMs? We're a long way from AGI. The lack of meaningful details in these announcements makes me pessimistic.
Some more pressing questions are:
* What new capabilities emerge as the models get better and better at predicting (i.e. loss goes down)?
* How much will it cost to train increasingly large models? And to run inference on them?
* How difficult will it be to find or generate more and more high quality data?