Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Unpredictable abilities emerging from large AI models

quantamagazine.org

Post reply on HN
Print view View original

41–50 of 326 posts

Re: Unpredictable abilities emerging from large AI models

#41

Post by ben_w »

ishvanl wrote: post #33

There is an idea bouncing around my brain for a pipe-dream science fiction book I could write, about the rise of the first truly sentient (or sentient-appearing) AI & its effects on the world. It is beginning to get to the point where I am considering whether I need to actually start writing this book before this "sci-fi" concept becomes a mundane reality.

> It is beginning to get to the point where I am considering whether I need to actually start writing this book before this "sci-fi" concept becomes a mundane reality.

Yes, write your book.

I've been trying to fix the dramatic conflict in mine for the last few years (spare time) without much progress, and mine has a specific calendar year backed into it.

Re: Unpredictable abilities emerging from large AI models

#42

Post by truculent »

pedrovhb wrote: post #10

This caught my attention as I found it implausible: > One DeepMind engineer even reported being able to convince ChatGPT that it was a Linux terminal and getting it to run some simple mathematical code to compute the first 10 prime numbers. Remarkably, it could finish the task faster than the same code running on a real Linux machine. Following the link, there's a screenshot to a screenshot [0] of a code-golf solutio…

So it sounds like the mechanism is something like stochastic memoisation?

Re: Unpredictable abilities emerging from large AI models

#43

Post by sinuhe69 »

OK, I repeated the same experiment, though with Google instead of GPT. I just translate the emoji to text (each emoji has associated keywords): movie girl fish clownfish pufferfish

And the first result? Finding Nemo!

Thus the association is obvious there and well known. People are just too willing to read more into it. I don’t know what is the bias called, but I believe it’s not totally unrelated to superstition.

Re: Unpredictable abilities emerging from large AI models

#44

Post by tarruda »

curiousgal wrote: post #15
mmaunder wrote: post #14

There is a startling acceleration of innovation in the field that GPT-4 illustrates. According to NVidia, LLM sizes have been increasing 10X per year for the last few years. This tech is going to hit every aspect of society like a sledgehammer over the next 48 months.

I guess you perception of society is severely limited if you think a fancy autocomplete is capable of changing every aspect of it.

That was what I thought until a few months ago when ChatGPT was released. I never cared much about LLMs because it always felt like a brute force method to solving problems.

What I'm seeing now is that some kind of intelligence seem to emerge from these models, even though under the hoods it is just a bunch o matrix multiplications.

Who's can say for sure that our own brains doesn't work similarly? Maybe human intelligence is something that emerges from similar primitives and AGI will simply be a really large language model.

Re: Unpredictable abilities emerging from large AI models

#45

Post by ChatGTP »

Madmallard wrote: post #30

I'm still convinced I'll be able to get GPT4 to solve all these difficult problems for me that I'm having trouble solving on my own. So far it hasn't been so great at doing it, but it's fun to at least try. For context I'm trying to get it to help me learn how to implement scalable multiplayer game servers in NodeJS. It's a tough code organization problem, it becomes a tough system design problem as well the bigger y…

It's probably going to struggle with things it hasn't seen before?

Re: Unpredictable abilities emerging from large AI models

#46

Post by ishvanl »

danielbln wrote: post #17
pajko wrote: post #11

I've asked ChatGPT to write an ode to the beer. This was the result: An ode to the frothy brew, The one that's crisp and true, A beer that's cool and light, The perfect drink for a summer's night. With every sip, a burst of hops, A refreshing taste that never stops, The gentle fizz, the golden hue, A symphony of flavors brewed just for you. Whether you're at a party or alone, A refreshing beer is like coming home, It…

I asked GPT-4 to take this ode and make it rhyme better, and to make it more clever and beautiful: A sonnet to the effervescent ale, The potion crisp, sincere, and hale, A quaff that's chilled and full of light, The ambrosia for a summer's twilight. With every draught, a surge of hop, A zestful taste that will not stop, The subtle fizz, the amber glow, A panoply of notes that flow. In festive throngs or solitaire, A…

I think this example really illustrates the leaps and bounds made between [Chat]GPT-3 & GPT-4. The first text sounds like some slightly shoddy marketing copy, or perhaps a high schooler's C-minus attempt at a creative writing class, but if you told me that the second text was an extract from a Tolkien novel, I'd probably believe you.

Re: Unpredictable abilities emerging from large AI models

#47

Post by tosser0001 »

namaria wrote: post #29
pedrovhb wrote: post #10

This caught my attention as I found it implausible: > One DeepMind engineer even reported being able to convince ChatGPT that it was a Linux terminal and getting it to run some simple mathematical code to compute the first 10 prime numbers. Remarkably, it could finish the task faster than the same code running on a real Linux machine. Following the link, there's a screenshot to a screenshot [0] of a code-golf solutio…

So on the one hand, these newly publicized models can render convincing representations of realities we used to get from deterministic processes. On the other hand, it's probabilistic and fails to conform to logic quite often, and in a confident way. We're building systems capable of programing computers non-deterministically. I think this is huge. But not because ChatGPT23 will be a CEO or a politician. But because…

I'm sort of glad to be retiring soon. I have a feeling everything I enjoy about programming is going to be going away.

Re: Unpredictable abilities emerging from large AI models

#48

Post by BiteCode_dev »

cosmodisk wrote: post #20
BiteCode_dev wrote: post #5

Earlier quoted context omitted.

Give it 2 years, it will happen, and it will make billions. In 5 years, unlimited interactive NSFW video games that will be personalized and remember you.

In 10 years this could effectively be the end of Hollywood. Imagine if it can write a story and feed into 3d engine and output pitch perfect videos.

Unlimited fully tailored netflix and steam.

Re: Unpredictable abilities emerging from large AI models

#50

Post by orwin »

Disclaimer : I did not test GPT 4 myself.

I think those emerging abilities are really interesting from a philosophical point of view, especially on the matter of consciousness.

It seems it really reinforce the illusionist point of view on the hard problem of consciousness, eg it doesn't really exist. It seems to reinforce most functionalist theories in fact. I would be really interested in what Chalmers think of those emerging abilities and how he update his theories.

Post reply on HN