Live data from Hacker News

GPT-3 Creative Fiction

gwern.net

11–20 of 103 posts

Re: GPT-3 Creative Fiction

#11

I still find it odd that we call this "artificial intelligence" when it's advanced mimicry at best. There's no "intelligence" in the strict definition of the word, it's just elaborate pattern matching. But I get it, it's exciting, and it's an easy way to get VC money. Perhaps one day we'll get something useful aside from the various pattern matching applications (image recognition, speech to text, etc). I'm skeptical…

I'm not disagreeing with you but where's the frontier between "pattern matching" and "intelligence"?

I also think human intelligence and creativity will always be judged by other humans as _better_, more genuine - as long as the judges can trust that given creation was lead by a human.

Among creative types "derivative" is a derogatory label used frequently. "Lesser artists borrow, great artists steal" also has an implication that regardless of what else an artist/creator does: pattern matching is a big part of that process.

Re: GPT-3 Creative Fiction

#13
post #11

I still find it odd that we call this "artificial intelligence" when it's advanced mimicry at best. There's no "intelligence" in the strict definition of the word, it's just elaborate pattern matching. But I get it, it's exciting, and it's an easy way to get VC money. Perhaps one day we'll get something useful aside from the various pattern matching applications (image recognition, speech to text, etc). I'm skeptical…

I'm not disagreeing with you but where's the frontier between "pattern matching" and "intelligence"? I also think human intelligence and creativity will always be judged by other humans as _better_, more genuine - as long as the judges can trust that given creation was lead by a human. Among creative types "derivative" is a derogatory label used frequently. "Lesser artists borrow, great artists steal" also has an imp…

That's a good point. I think we need to have a better understanding about how the brain works before we can properly answer that question. At this point there's a lot we don't understand about the brain, and psychology for that matter, it's basically a black box that we can observe through a microscope or other imaging system but we don't really understand what's happening.

An ant only has around 250,000 neurons, yet they're still more intelligent than the most advanced "AI" we've managed to produce.

An ant may not be able to paint a painting or write a novel, but I think most people agree they qualify as an intelligent being.

Re: GPT-3 Creative Fiction

#14

GPT's take on the navy seal copypasta, in the style of a KGB spy: "I have over 300 confirmed red scares." Haha, that is genuinely one of the funniest versions of that I've ever seen, human-generated or otherwise. That level of inference is really amazing.

I must agree reading those copypasta, "300 red scares" and "300 confirmed scoots" had me close to tears.

Re: GPT-3 Creative Fiction

#16
I'm gonna put forward the very view that gwern repeatedly argues against: "but... it's not understanding."

So far I see no evidence that this thing or anything else like it has any actual understanding, any model of the world. Indeed it can't as it possesses no sensory apparatus. It's not embodied. It doesn't experience anything.

I'm not sure the OpenAI folks would argue with me, but it seems Gwern asserts that this sort of thing indicates that general AI or even sentient AI is on the doorstep. I don't think it does, and I still maintain as I always have that CS people systematically underestimate and trivialize biology.

Re: GPT-3 Creative Fiction

#17
This is fascinating to read through. It’s so hard to avoid a variant of the Forer effect, though - where we unconsciously discount the errors, and selectively focus on subsets of the output and impute meaning to them.

Designing objective quality tests must be an active area of research, I wonder what the best approaches are?

Re: GPT-3 Creative Fiction

#18
post #11

Earlier quoted context omitted.

I'm not disagreeing with you but where's the frontier between "pattern matching" and "intelligence"? I also think human intelligence and creativity will always be judged by other humans as _better_, more genuine - as long as the judges can trust that given creation was lead by a human. Among creative types "derivative" is a derogatory label used frequently. "Lesser artists borrow, great artists steal" also has an imp…

That's a good point. I think we need to have a better understanding about how the brain works before we can properly answer that question. At this point there's a lot we don't understand about the brain, and psychology for that matter, it's basically a black box that we can observe through a microscope or other imaging system but we don't really understand what's happening. An ant only has around 250,000 neurons, yet…

Can we really call this ANTNN "intelligent" when it falls victim to trivial adversarial inputs? Ones that arise in the real world, not just in artificial inputs mind you. Clearly those ANTNNs are still far from anything that could rival natural intelligences.

https://www.youtube.com/embed/mA37cb10WMU

Re: GPT-3 Creative Fiction

#19
Holy crapoly.

The quality (in both senses) of the output given an appropriately constructed prompt is incredible.

I wonder if it's possible to get it to do the opposite of summarizing, ie. give it a plot summary and have it expand it into a fleshed out story that conforms to the summary...

Re: GPT-3 Creative Fiction

#20
post #12

Straight up plagiarizes The Beatles here: https://www.gwern.net/GPT-3#dr.-seuss-oh-the-places-youll-go " There’s nothing you can know that isn’t known. Nothing you can see that isn’t shown. Nowhere you can be that isn’t where you’re meant to be. "

Well, it's easy.
Post reply on HN