Am I the only that thinks that anything similar to AGI will come not from raw model capacity but from model speed and efficiency? In my experience the harness is more important than the model, and anything able to run at 700tps will be the "next big thing". PS: assuming the current architecture is the right one
Why would speed matter? Surely an AGI could think slowly but still be an AGI
So more tokens/variability and slow or fewer tokens and fast.
There seems to be a threshold tho, like taalas is super fast but that model is so dumb, being dumb faster doesn't work, seems to be some minimum requirements.