Multiple times per week I have the same conversation. It goes something like this: - AI will make developers irrelevant - Why? - Because LLMs can write code - Do you know what I do for a living? - Yes, write code? - Yes, about 2-5% of the time. Less now. - But you said you are a developer? - I did - So what do you do 95-98% of the time? - I understand things and then apply my ability to formulate solutions - But I ca…
LLMs also can “understand things and apply their ability to formulate solutions”. There is nothing that will inherently limit AI from doing all knowledge work (and all physical work once robotics is good enough). Of course developers could just move up the “next level of abstraction” and become managers of agents who write the code, but eventually AI becomes a better manager of agents than even the best humans, at wh…
The open question is not “can next-token prediction produce impressive behavior?” Clearly it can. The question is whether scaling that mechanism is enough to produce stable world models, grounded understanding, long-horizon agency, self-correction, and reliable reasoning across novel situations.
That has not been demonstrated.
In the past few years I've repeated the same thing: I'm not afraid of AIs that are hallucinating. They do that by design. It is expected. What scares me is people who hallucinate something into existence which isn't there.