Live data from Hacker News

AGI is far from inevitable

ru.nl

11–20 of 258 posts

Re: AGI is far from inevitable

#11
post #8

> There will never be enough computing power to create AGI using machine learning that can do the same [as the human brain], because we’d run out of natural resources long before we'd even get close I don’t understand how people can so confidently make claims like this. We might underestimate how difficult AGI is, but come on?!

For some people, "never" means something like "I wouldn't know how, so surely not by next year, and probably not even in ten".

Re: AGI is far from inevitable

#12
I skimmed through the paper and couldn't make much sense of it. In particular, I don't understand how their results don't imply that human-level intelligence can't exist.

After all, earth could be understood as solar powered super computer, that took a couple of million years to produce humanity.

Re: AGI is far from inevitable

#14
post #6

Basically the linked article argues like this: > That’s because cognition, or the ability to observe, learn and gain new insight, is incredibly hard to replicate through AI on the scale that it occurs in the human brain. (no other more substantial arguments were given) I'm also very skeptical on seeing AGI soon, but LLMs do solve problems that people thought were extremely difficult to solve ten years ago.

  > but LLMs do solve problems that people thought were extremely difficult to solve ten years ago.
Well for something to be G or I you need them to solve novel problems. These things have interested most of the Internet and I've yet to see a "reasoning" disentangle memorization from reasoning. Memorization doesn't mean they aren't useful (not sure why this was ever conflated since... Computers are useful...), but it's very different from G or I. And remember that these tools are trained for human preferential output. If humans prefer things to look like reasoning then that's what they optimize. [0]

Sure, maybe your cousin Throckmorton is dumb but that's besides the point.

That said, I see no reason human level cognition is impossible. We're not magic. We're machines that follow the laws of physics. ML systems may be far from capturing what goes on in these computers, but that doesn't mean magic exists.

[0] If it walks like a duck, quacks like a duck, and swims like a duck, and looks like a duck it's probably a duck. But probably doesn't mean it isn't a well made animatronic. We have those too and they'll convince many humans they are ducks. But that doesn't change what's inside. The subtly matters.

Re: AGI is far from inevitable

#15
post #6

Basically the linked article argues like this: > That’s because cognition, or the ability to observe, learn and gain new insight, is incredibly hard to replicate through AI on the scale that it occurs in the human brain. (no other more substantial arguments were given) I'm also very skeptical on seeing AGI soon, but LLMs do solve problems that people thought were extremely difficult to solve ten years ago.

Are you talking about the press release that the story on HN currently links to, or the paper that press release is about? The paper (I'm not vouching for it; I just skimmed it) appears to reduce AGI to a theoretical computational model, and then supplies a proof that it's not solvable in polynomial time.

Re: AGI is far from inevitable

#16
post #8

> There will never be enough computing power to create AGI using machine learning that can do the same [as the human brain], because we’d run out of natural resources long before we'd even get close I don’t understand how people can so confidently make claims like this. We might underestimate how difficult AGI is, but come on?!

"There will never be enough computing power to compute the motion of the planets because we can't build a planet."

Re: AGI is far from inevitable

#17
This is silly. They article talks like we have any idea at all how efficient machine learning can be. As I remember it, the LLM boom came from transformers turning out to scale a lot better than anyone expected, so I’m not sure why something similar couldn’t happen again.

Re: AGI is far from inevitable

#18
post #15
post #6

Basically the linked article argues like this: > That’s because cognition, or the ability to observe, learn and gain new insight, is incredibly hard to replicate through AI on the scale that it occurs in the human brain. (no other more substantial arguments were given) I'm also very skeptical on seeing AGI soon, but LLMs do solve problems that people thought were extremely difficult to solve ten years ago.

Are you talking about the press release that the story on HN currently links to, or the paper that press release is about? The paper (I'm not vouching for it; I just skimmed it) appears to reduce AGI to a theoretical computational model, and then supplies a proof that it's not solvable in polynomial time.

I was referring to the press release article. I also looked at the paper now, and to me their presented proof looked more like a technicality than a new insight.

If it's not solvable in polynomial time, how did nature solve it in a couple of million years?

Re: AGI is far from inevitable

#19
post #2

AGI is about as far away as it was two decades ago. Language models are merely a dent, and probably will be the precursor to a natural language interface to the thing.

We are clearly closer than 20 years ago - o1 is an order of magnitude closer than anything in the mid-2000s.

Also I would think most people would consider AGI science fiction in 2004 - now we consider it a technical possibility which demonstrates a huge change.

Re: AGI is far from inevitable

#20
"unlikely to ever come to fruition" is more baseless than suggesting AGI is imminent.

I'm not an AGI optimist myself, but I'd be very surprised if a time traveller told me that mankind won't have AGI by, say, 2250.

Post reply on HN