Live data from Hacker News

Humanity isn't ready for the coming intelligence explosion

economist.com

181–190 of 524 posts

Re: Humanity isn't ready for the coming intelligence explosion

#181

How far are we from reliable AI? One that could, for example, handle 80% of office jobs without screwing up more than humans?

Hard to say, because jobs and processes will adjust to accommodate AI strengths and deficiencies, as AI usage increases.

It's similar to how automation in manufacturing works: we may start with augmenting the human workers with machines improving some parts of the process, but eventually the process itself gets redesigned around the machines.

Re: Humanity isn't ready for the coming intelligence explosion

#183

Like my grandfather used to say "They let anyone on TV now", They let anyone be called an expert now. Love talking about 'recursive self-improvement' of a prediction engine. What about 'recursive self-degradation'?

Regression tests

Re: Humanity isn't ready for the coming intelligence explosion

#185

Earlier quoted context omitted.

Have they? I don't like it either but the headline bull predictions(reliable agents and most code written by AI by mid-2026, dramatic progress against jailbreaks, prompt injection, hallucination, etc., major improvements despite pretraining data exhaustion, continued exponential growth on the METR trendline) did come true, often ahead of even aggressive schedules. What major wrong predictions did you have in mind?

Literally none of the predictions you listed in your post came true. We don't have reliable agents, AI isn't writing most code, hallucinations still happen all the time, improvement has been basically non-existent. Despite the constant claims of these experts and AI boosters, AI is still not a tool one can use to get meaningful work done.

This is called denial.

Re: Humanity isn't ready for the coming intelligence explosion

#186
post #141

Earlier quoted context omitted.

But I do live with it. It lives in my kitchen.

In the pecking order, it is under, not on your side. Your toaster never demanded you to make a toast.

Once you actually use the toaster the hierarchy inverts. The toaster runs your entire household while it is powered on.

Unattended ChatGPT will rarely burn your breakfast or start fires.

Re: Humanity isn't ready for the coming intelligence explosion

#188
post #166

Why should we assume AI can rapidly turn into super intelligence when physical and critical resources like energy and materials remain under human control?

If you limit the "we" in your question to the people invested into this, then the answer is clear. Those juicy IPOs are about to go through.

Re: Humanity isn't ready for the coming intelligence explosion

#189

We don't need to live "side by side" with AI. AI is not alive, it's a technology we use. This is like talking about living side by side with your toaster.

"Alive" is irrelevant. Bullshit like "alive", "sentient" or "conscious" doesn't decide much, at the day's end. It just distracts from the thing that matters. And the thing that matters is: capability. Even today's AIs are capable of autonomous goal-oriented agentic behavior - and growing more and more so with every release. At sufficient capability, AI stops being "a technology we use", and becomes a force in itself…

DNNs/LLMs can only predict next tokens based on training data. They often make big direction mistakes as they are particularly bad at common sense. Kind of like the Paperclip Maximizer scenario. They need a human with deep knowledge to drive them and to catch them when they go off the rails.

Re: Humanity isn't ready for the coming intelligence explosion

#190

Earlier quoted context omitted.

Yes, I think AI has eliminated writing code. Everyone I personally know working in software stopped writing code some time between December and March. (It's true that AI continues to routinely make errors; if you've heard the term "agentic workflows", that's the standard strategy for mitigating the error rate by allowing the AI to check its own work.) That's why I think Amodei's January 2026 prediction that AI could…

> Yes, I think AI has eliminated writing code. Then you are dead wrong. Anyone who gives a shit about doing a good job is still writing code.

If you can describe the code you want to write, AI can write it exactly the way you would have, but faster than you every time. That is the floor now.
Post reply on HN