Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Sparks of Artificial General Intelligence: Early Experiments with GPT-4

arxiv.org

Post reply on HN
Print view View original

11–20 of 244 posts

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#11

Post by georgehill »

atleastoptimal wrote: post #6
georgehill wrote: post #2

> Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. I don't know why, but my brain refuses to accept GPT-4 as something close to AGI. Maybe I am wrong. It is hard to believe that our brain is just a bunch of attention layers and neural nets.

> It is hard to believe that our brain is just a bunch of attention layers and neural nets. Our brain isn't, but I'd wager the architectural complexity of a physical, neuronal brain is not optimized for all useful mental tasks, and has perhaps a fair amount of local maxima that are near vestigial in overall positive impact on cognition. Just because the human brain model of cognition is the only way nature has been a…

I agree that GI can have a different implementation compared to our human brain, but one thing is for sure: as of right now, the human brain can become more creative with a fraction of the data consumed by GPT-4.

GPT-4 could be AGI, but it feels like cheating to achieve AGI by feeding the entire internet. If someone can build AGI with only the data that humans consume in their lifetime, then that, imho, is the real AGI.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#12

Post by georgehill »

adroniser wrote: post #7
georgehill wrote: post #2

> Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. I don't know why, but my brain refuses to accept GPT-4 as something close to AGI. Maybe I am wrong. It is hard to believe that our brain is just a bunch of attention layers and neural nets.

Do you think anything digital could ever become conscious?

yes

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#13

Post by _gabe_ »

> Given the breadth and depth of GPT-4's capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system.

But it's just statistics, a fancy text predictor, a Markov-chain. Surely these scientists that work in the field of AI and are intimately familiar with how this stuff works aren't so stupid as to think emergent behavior potentially resembling intelligence could result from such simple systems? It's just statistics after all. Given enough training, any neural net could guess the next best token. It trained off all of Google after all. It's just looking up the answers. No hint of intelligence. Just a mindless machine. After all, the saying goes, "If it walks like a duck and quacks like a duck, it must be a mindless machine that has no bearing on a duck whatsoever". /s

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#14

Post by outlace »

ChatGPT and its relatives are very very impressive on first impressions, but I've been using ChatGPT-3 and now 4 heavily every day since they became available to individuals and once you start using them this much it becomes very clear how NOT intelligent they are. It really just seems like extremely impressive statistical inference after this much use and finding so many failure modes. But it is still impressive how much of human intellectual endeavors can be captured by sophisticated statistical inference. Very useful technology nonetheless.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#15

Post by serverholic »

adroniser wrote: post #7
georgehill wrote: post #2

> Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. I don't know why, but my brain refuses to accept GPT-4 as something close to AGI. Maybe I am wrong. It is hard to believe that our brain is just a bunch of attention layers and neural nets.

Do you think anything digital could ever become conscious?

[dead]

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#16

Post by Avicebron »

georgehill wrote: post #11
atleastoptimal wrote: post #6

Earlier quoted context omitted.

> It is hard to believe that our brain is just a bunch of attention layers and neural nets. Our brain isn't, but I'd wager the architectural complexity of a physical, neuronal brain is not optimized for all useful mental tasks, and has perhaps a fair amount of local maxima that are near vestigial in overall positive impact on cognition. Just because the human brain model of cognition is the only way nature has been a…

I agree that GI can have a different implementation compared to our human brain, but one thing is for sure: as of right now, the human brain can become more creative with a fraction of the data consumed by GPT-4. GPT-4 could be AGI, but it feels like cheating to achieve AGI by feeding the entire internet. If someone can build AGI with only the data that humans consume in their lifetime, then that, imho, is the real A…

or better yet, chuck it in an open plain and see how long it takes to figure out how to attach a rock to a stick and fight a gazelle to refuel it's energy supply.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#17

Post by hotpotamus »

georgehill wrote: post #2

> Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. I don't know why, but my brain refuses to accept GPT-4 as something close to AGI. Maybe I am wrong. It is hard to believe that our brain is just a bunch of attention layers and neural nets.

"We are the meat in our heads" is the way I've heard it said that human intelligence is just a physical phenomenon created by our brains. And there was never any reason to believe that intelligence could not arise from other substrates.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#19

Post by carapace »

georgehill wrote: post #2

> Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. I don't know why, but my brain refuses to accept GPT-4 as something close to AGI. Maybe I am wrong. It is hard to believe that our brain is just a bunch of attention layers and neural nets.

It seems clear to me that these systems think in a meaningful sense, but I don't think they are beings. In Cybernetics there is a result that says that any well-regulated system must contain a model of itself. This seems as good a definition as any of a "being", and by this definition these language models don't make the cut.
Post reply on HN