Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Road to Artificial General Intelligence

maraoz.com

Post reply on HN
Print view View original

21–30 of 104 posts

Re: Road to Artificial General Intelligence

#21

Post by whatever1 »

bigyikes wrote: post #19

I’ve been starting to wonder, is GPT-3 the beginning of AGI? I know, I know, it’s just a language model. But I’ve been thinking. About my thinking. I think in words. I solve problems in words. I communicate results in words. If I had no body, and you could only interact with me via text, would I look that much different than GPT? Does AGI really need anything more than words? Is it possible that simply adding more pa…

Words are just an interface we use.

I believe that thinking and idea generation is much more abstract than words. Animals seem to do a lot of idea generation (improvisation) without knowing about words.

But they cannot pass this knowledge efficiently, except from imitation.

Re: Road to Artificial General Intelligence

#22

Post by jakeinspace »

bigyikes wrote: post #19

I’ve been starting to wonder, is GPT-3 the beginning of AGI? I know, I know, it’s just a language model. But I’ve been thinking. About my thinking. I think in words. I solve problems in words. I communicate results in words. If I had no body, and you could only interact with me via text, would I look that much different than GPT? Does AGI really need anything more than words? Is it possible that simply adding more pa…

If you had no body starting this moment, your mind would still have benefited from years of interacting with and receiving stimuli from the physical world. GPT-3 isn’t so fortunate

Re: Road to Artificial General Intelligence

#23

Post by masswerk »

> In the early days of artificial intelligence, the field was defined by a single goal: to build a machine that could think and behave like a human. (…) We can now build machines that can beat humans at specific tasks like playing chess or go, and we are starting to see machines that can learn to perform multiple tasks.

I'd say, "machine beats human in chess" doesn't mean what it was supposed to mean in Turing's days. Meaning, rather than being a proof of deep consideration, it has moved towards generalizing pattern recognition and library lookups. Rather than proving a point in (ad-hoc) decision making (Turing's "ban"), it's an application of data.

Re: Road to Artificial General Intelligence

#24

Post by bigyikes »

jakeinspace wrote: post #22
bigyikes wrote: post #19

I’ve been starting to wonder, is GPT-3 the beginning of AGI? I know, I know, it’s just a language model. But I’ve been thinking. About my thinking. I think in words. I solve problems in words. I communicate results in words. If I had no body, and you could only interact with me via text, would I look that much different than GPT? Does AGI really need anything more than words? Is it possible that simply adding more pa…

If you had no body starting this moment, your mind would still have benefited from years of interacting with and receiving stimuli from the physical world. GPT-3 isn’t so fortunate

Those years of training are surely helpful, but are they strictly necessary? I don’t see why AGI couldn’t infer much of the experiences by reading text.

Re: Road to Artificial General Intelligence

#25

Post by bismuthcrystal »

bigyikes wrote: post #19

I’ve been starting to wonder, is GPT-3 the beginning of AGI? I know, I know, it’s just a language model. But I’ve been thinking. About my thinking. I think in words. I solve problems in words. I communicate results in words. If I had no body, and you could only interact with me via text, would I look that much different than GPT? Does AGI really need anything more than words? Is it possible that simply adding more pa…

Or perhaps words are the byproduct of the real thing. Consider the moments where your mind just click and solves something. You find it hard to map words to what happened. Or when you judge a situation to be dangerous, you just kind of know it, and then you map your gut feeling into words so you can explain to someone.

Perhaps "intelligence" is the process that enables these leaps between islands of words.

Re: Road to Artificial General Intelligence

#26

Post by jakeinspace »

frgtpsswrdlame wrote: post #10

The already placed checkmarks are wrong. An AGI by this list would be able to beat humans at chess and win an art competition, both of which are already checked off. But the chess playing AI and the art competition AI are completely separate systems, the art AI can't win a game at chess, it doesn't know a single thing about chess and it's never going to and vice versa. By this checkmark logic you could complete the w…

Just curious, is it absolutely necessary that a single model can solve all these problems to satisfy you? As long as it’s a finite and relatively small list, why not allow for N models boxed together wrapped in a switch statement? Or if you’re picky, a top-level language model which tries to decide which of its subsystems to employ for the problem at hand. After all, the human brain is at least somewhat partitioned (although not at the granularity of chess vs hotdog identification).

Re: Road to Artificial General Intelligence

#27

Post by fastball »

masswerk wrote: post #23

> In the early days of artificial intelligence, the field was defined by a single goal: to build a machine that could think and behave like a human. (…) We can now build machines that can beat humans at specific tasks like playing chess or go, and we are starting to see machines that can learn to perform multiple tasks. I'd say, "machine beats human in chess" doesn't mean what it was supposed to mean in Turing's days…

AlphaZero is not using "library lookups" to play chess.

Re: Road to Artificial General Intelligence

#28

Post by sweetbitter »

bigyikes wrote: post #19

I’ve been starting to wonder, is GPT-3 the beginning of AGI? I know, I know, it’s just a language model. But I’ve been thinking. About my thinking. I think in words. I solve problems in words. I communicate results in words. If I had no body, and you could only interact with me via text, would I look that much different than GPT? Does AGI really need anything more than words? Is it possible that simply adding more pa…

You only think in words?

Re: Road to Artificial General Intelligence

#30

Post by masswerk »

bigyikes wrote: post #24
jakeinspace wrote: post #22

Earlier quoted context omitted.

If you had no body starting this moment, your mind would still have benefited from years of interacting with and receiving stimuli from the physical world. GPT-3 isn’t so fortunate

Those years of training are surely helpful, but are they strictly necessary? I don’t see why AGI couldn’t infer much of the experiences by reading text.

It's quite literary the embodiment of statistical probabilities in this corpus of texts. So you have to start with a rather massive corpus and the complexities found in this corpus will define the complexities possibly found in the model.
Post reply on HN