Is it official then? Most of us have been waiting for this moment for a while. The transformer architecture as it is currently understood can't be milked any further. Many of us knew this since last year. GPT-5 delays eventually led to non-tech voices to suggest likewise. But we all held our final decision until the next big release from OpenAI as Sam Altman has been making claims about AGI entering the workforce thi…
It's worth pointing out that GPT-4.5 seems focused on better pre-training and doesn't include reasoning. I think GPT-5 - if/when it happens - will be 4.5 with reasoning, and as such it will feel very different. The barrier, is the computational cost of it. Once 4.5 gets down to similar costs to 4.0 - which could be achieved through various optimization steps (what happened to the ternary stuff that was published last…
I don’t feel like this binary shift is adequately accounted for among the LLM cynics.