Another CEO with AI psychosis [1]. LLMs are not true AI, they lack common sense (or whatever it's properly called). LLM-based systems still need somebody with deep domain knowledge at the wheel to keep them from doing stupid things. It's like an alien-made bicycle that gets you to the speed of sound if you are an Olympic cyclist.
Still, LLMs are extremely powerful pseudo-AI [2] and will bring a pseudo-singularity. But the impact is still scary if a tiny fraction of humans are augmented 1000x. And as better models become exponentially more costly, only the money people will be able to afford the new models. This is a very likely scenario and scares me to the point I dropped all my projects to work on affordable LLM-based tools to make the difference at most 10x instead of 1000x.
To my elder relatives I explain it like: imagine we are farmers in the 17th century and suddenly out of nowere John Deere tractors, combines, etc. become available. But they cost more to run than all you and your fellow farmers have, so only a tiny handful of rich people take over everything.
[1] https://en.wikipedia.org/wiki/Chatbot_psychosis
[2] https://en.wikipedia.org/wiki/Chinese_room