Live data from Hacker News

Sparks of Artificial General Intelligence: Early Experiments with GPT-4

arxiv.org

201–210 of 244 posts

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#201

> Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. I don't know why, but my brain refuses to accept GPT-4 as something close to AGI. Maybe I am wrong. It is hard to believe that our brain is just a bunch of attention layers and neural nets.

Do you think anything digital could ever become conscious?

The differences between ChatGPT and a conscious human brain are not unsurmountable.

Let's consider a potential future conscious AGI created by advancing from something like ChatGPT.

The human brain is "always on". It's possible to have a digital system be always on, i.e. not just train once and then just respond, but constantly take new input.

The human brain has way more connections/layers than ChatGPT. It's possible to imagine the digital system getting the same number of connections.

The human brain gets real time sensory input. It's possible to add cameras, microphones, etc to that digital system so it gets a constant feed. Maybe even let it process what it saw during the day in a batch training/GC run (we could call that "sleep").

The human brain has a different topology. It's possible to alter the topology of a digital system neural network to mimick that, instead of using the ChatGPT topology. It's not like we're forever doomed to its simpler statistical model. But it's interesting that it already gets very significant emergent intelligence-like properties.

The human brain is self-conscious. This can very well be an emergent property of the above. I think all that's needed is the ability to have some form feedback mechanism.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#202

Earlier quoted context omitted.

Do you think anything digital could ever become conscious?

The question is whether consciousness is computable. Can a Turing machine be conscious? Probably not. https://www.newscientist.com/article/mg25634130-100-roger-pe... https://www.youtube.com/watch?v=hXgqik6HXc0

Note that Penrose's answer is not the "consensus".

Also, Penrose doesn't conver if I recall correctly about modelling the quantum part too. It's just statistics after all.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#203

Can we agree that an "early (yet still incomplete) version of AGI" isn't AGI?

I hope we can agree that “not completely X” is “not X”.

Why would we agree on that? Anything "not completely X" surely the attribute of aproaching Xness, else it would just be "not X".

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#204

Earlier quoted context omitted.

The question is whether consciousness is computable. Can a Turing machine be conscious? Probably not. https://www.newscientist.com/article/mg25634130-100-roger-pe... https://www.youtube.com/watch?v=hXgqik6HXc0

Note that Penrose's answer is not the "consensus". Also, Penrose doesn't conver if I recall correctly about modelling the quantum part too. It's just statistics after all.

So the consensus is that consciousness is computable by a Turing machine?

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#205
post #178

Earlier quoted context omitted.

it is a markov chain; At least the underlying decoder only transformer is.

GPT-4 disagrees: GPT-3.5, like its predecessor GPT-3, is not a Markov chain. GPT-3.5 is based on the GPT (Generative Pre-trained Transformer) architecture, which is a type of neural network known as a Transformer. Transformers use self-attention mechanisms to process and generate text, allowing them to capture long-range dependencies and context in the input data. On the other hand, a Markov chain is a stochastic mod…

It's wrong. A decoder only transformer performs a (possibly random) operation on a state from the state space {tokens}^CtxWindow, where the distribution of the new state depends entirely on the previous state. It is a Markov Chain with a special structure: The new state is deterministically equal to the old state shifted by one, with only the last token being newly generated.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#206
post #199
post #178

Earlier quoted context omitted.

it is a markov chain; At least the underlying decoder only transformer is.

It's not. It can do in context learning, which Markov chains cannot do.

It is a Markov Chain on the state space {Tokens}^CtxWindow.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#207
post #14

ChatGPT and its relatives are very very impressive on first impressions, but I've been using ChatGPT-3 and now 4 heavily every day since they became available to individuals and once you start using them this much it becomes very clear how NOT intelligent they are. It really just seems like extremely impressive statistical inference after this much use and finding so many failure modes. But it is still impressive how…

> how NOT intelligent they are In what sense? How do you define intelligence and what is missing? > finding so many failure modes. Failures do not indicate a lack of intelligence. People make errors all the time. We should differentiate failures which arise from poor training for a lack of general capabilities. There are people who learned a bad way to do something and struggle to change that. Should we consider them…

We are talking about a computer program that cannot make decisions. Often times human intelligence is compared with the types of decisions the person makes.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#208

[This is in reply to the comments not the article!] It's just a statistical model is the logical equivalent of human beings are just a bunch of atoms. The amount of reductionist thinking that goes on in tech is hilarious. First define AGI then challenge an AI to meet those requirements. If it meets them it is AGI. Put aside your preconceptions of what technology you think is required to achieve the goals and stay emp…

> It's just a statistical model is the logical equivalent of human beings are just a bunch of atoms. Not exactly. One says "human beings are just a bunch of atoms" referring to the low level constituans (in a reductionistic way), but not making an accessment about the abilities emerging from those atoms in their interactions when in the form of a human. But when one says that GPT is "just a statistical model" they're…

> But when one says that GPT is "just a statistical model" they're implying a capacity cap of statistical models

Except there is no “capacity cap” on statistical models, we have no idea what they are or are not capable of yet.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#209

Earlier quoted context omitted.

I've been trying to make it be a DM for a while now. It works seemingly well for a while but it's making everything up on the fly, which is fine as long as there's not state that needs to be maintained/remembered. Once you start trying to get it to do combat, it seems like it's working pretty well but eventually you realize that it's just making shit up behind the scenes. It'll tell you there are 4 goblins ambushing…

So you’re complaining it’s not smart in a way it was explicitly designed not to be (keep too long a context) so it doesn’t take over the world..

No. It's much worse than that. It doesn't remember what it just said the message before.

The thing I don't understand about it is that it works pretty great for a while but, eventually, it starts acting erratically, forgetting things it knew, not following instructions, etc. It's not that it forgets old things or can't learn new things, it just becomes dumb.

Maybe that's what you're talking about but I don't think AGI is going to have the memory of a goldfish.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#210

Earlier quoted context omitted.

Note that Penrose's answer is not the "consensus". Also, Penrose doesn't conver if I recall correctly about modelling the quantum part too. It's just statistics after all.

So the consensus is that consciousness is computable by a Turing machine?

The consensus is that if it's not, it's not because of the reasons Penrose gives.
Post reply on HN