The imagined computers that looked so unrealistic in so many past science-fiction movies and TV shows no longer look... unrealistic. Those imagined computers now look more like upgrades to current technology. Imagine an AI model 10x, 100x, 1000x larger than GPT4. That feels... surreal to me.
> Those imagined computers now look more like upgrades to current technology. I still don't get that argument. You can train a parrot for a week and he'll talk a few words, training it for a year won't make him become Shakespeare, LLMs will never ever automagically evolve into these AGI tier computers, not even their creators argue that, no one besides techbros argue that in fact.
People say "it's just parroting what it's heard"! But did GPT4's training data really include a sonnet about Minecraft creepers?
So they're not parroting. They're parroting PLUS something else. Plus some kind of analysis and transformation.
Your claim is that this transformation is superficial and won't become deeper as the neural networks become deeper.
We'll see.