Live data from Hacker News

Sparks of Artificial General Intelligence: Early Experiments with GPT-4

arxiv.org

171–180 of 244 posts

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#171
post #135

Earlier quoted context omitted.

Why not let it do all the work then?

It's not perfect, ofcourse.

It also can't actually start anything on its own. That is, it has no motivation, like an actual AGI would. Don't pollute that term also. An Artificial General Intelligence is something like Asimov's robots or R2D2, not search-on-steroids.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#172

Earlier quoted context omitted.

Rename ChatGPT to Clippy.

I wouldn't be surprised if they actually brought back Clippy as a character now that the technology's improved

They've moved on to Cortana, or Sydney, I suppose.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#173
post #134

Earlier quoted context omitted.

No it's a Chinese room but instead of Chinese it's stack overflow snippets

So what? If it writes novels like an AGI, codes like an AGI and explains complex topics like an AGI, then it's probably an AGI...

That's just it. It doesn't.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#174
post #151

Earlier quoted context omitted.

I've been trying to make it be a DM for a while now. It works seemingly well for a while but it's making everything up on the fly, which is fine as long as there's not state that needs to be maintained/remembered. Once you start trying to get it to do combat, it seems like it's working pretty well but eventually you realize that it's just making shit up behind the scenes. It'll tell you there are 4 goblins ambushing…

You should put a blog/site up with some examples. "GPT being the worst DM ever" sounds hilarious. "I attack the goblin." "What goblin?" "The goblin you just said was there." "I'm sorry, I was mistaken. It's actually a Beholder."

I think this could make for a hilarious animated series. Kind of an AI-generated mashup between HarmonQuest[1] and DrunkHistory[2]

[1] https://en.wikipedia.org/wiki/HarmonQuest [2] https://en.wikipedia.org/wiki/Drunk_History

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#175
post #61

Earlier quoted context omitted.

- "ftxbro"

After lurking I made this account only to post a joking-not-joking explanation of why Alameda had the weirdly specific credit limit $65,355,999,994 with FTX and why I thought it could be a funny off-by-almost-1000x bug/typo/mishap https://news.ycombinator.com/item?id=34473811 but I think almost no one read my comment because I posted it so late after the thread had scrolled off the front page :(

I appreciated it :)

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#176

> Given the breadth and depth of GPT-4’s capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. I don't know why, but my brain refuses to accept GPT-4 as something close to AGI. Maybe I am wrong. It is hard to believe that our brain is just a bunch of attention layers and neural nets.

It seems clear to me that these systems think in a meaningful sense, but I don't think they are beings . In Cybernetics there is a result that says that any well-regulated system must contain a model of itself. This seems as good a definition as any of a "being", and by this definition these language models don't make the cut.

The architecture for large language models is summarized in the training set for large language models. With fairly minimal modification such as via a plug-in, chatGPT and the like are Turing complete and can thus model themselves.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#177
post #13

> Given the breadth and depth of GPT-4's capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. But it's just statistics, a fancy text predictor, a Markov-chain. Surely these scientists that work in the field of AI and are intimately familiar with how this stuff works aren't so stupid as to think emergent behavior pote…

Quantum mechanics is, well, statistics.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#178
post #13

> Given the breadth and depth of GPT-4's capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. But it's just statistics, a fancy text predictor, a Markov-chain. Surely these scientists that work in the field of AI and are intimately familiar with how this stuff works aren't so stupid as to think emergent behavior pote…

GPT-4 is often overhyped and underhyped because few really understand it. It's not a Markov Chain or a fancy text predictor. It's a ~200 layer neural network that models a vast hierarchy of concepts through language. It has emergent properties that we don't yet understand.

it is a markov chain; At least the underlying decoder only transformer is.

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#179

I remember reading this somewhere - "There is a considerable overlap between the intelligence of the smartest bears and the dumbest tourists.". Though I do not think GPT-4 is even close to AGI it can definitely claim to be better at faking it than many intelligent beings can.

so strange. I heard that saying for the first time yesterday on a youtube video comment section. Weird I've seen in it twice in less than 24 hours

Re: Sparks of Artificial General Intelligence: Early Experiments with GPT-4

#180
post #178

Earlier quoted context omitted.

GPT-4 is often overhyped and underhyped because few really understand it. It's not a Markov Chain or a fancy text predictor. It's a ~200 layer neural network that models a vast hierarchy of concepts through language. It has emergent properties that we don't yet understand.

it is a markov chain; At least the underlying decoder only transformer is.

GPT-4 disagrees:

GPT-3.5, like its predecessor GPT-3, is not a Markov chain. GPT-3.5 is based on the GPT (Generative Pre-trained Transformer) architecture, which is a type of neural network known as a Transformer. Transformers use self-attention mechanisms to process and generate text, allowing them to capture long-range dependencies and context in the input data.

On the other hand, a Markov chain is a stochastic model that describes a sequence of possible events, where the probability of each event depends only on the state attained in the previous event. While Markov chains can be used for simple text generation, they lack the ability to capture the complex relationships and long-range dependencies that GPT-3.5 can handle.

Post reply on HN