Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-3 Creative Fiction

gwern.net

Post reply on HN
Print view View original

51–60 of 103 posts

Re: GPT-3 Creative Fiction

#51

Post by ixvvqktiwl »

gwern wrote: post #44
ixvvqktiwl wrote: post #9

I still find it odd that we call this "artificial intelligence" when it's advanced mimicry at best. There's no "intelligence" in the strict definition of the word, it's just elaborate pattern matching. But I get it, it's exciting, and it's an easy way to get VC money. Perhaps one day we'll get something useful aside from the various pattern matching applications (image recognition, speech to text, etc). I'm skeptical…

I'm sorry, your comment explaining why deep learning & GPT-3 do not truly understand anything is more poorly reasoned and explained than GPT-3's explanation why GPT-3 does not truly understand anything: https://www.gwern.net/GPT-3#why-deep-learning-will-never-tru... While it's true that recent natural neural net models like ixvvqktiwl may sound superficially coherent and like they 'understand' things, we can see by c…

I understand you're trying to be funny, but I think insults are against the HN site guidelines.

Re: GPT-3 Creative Fiction

#52

Post by mintplant »

It writes uncomfortably coherent and witty fatalist My Little Pony fanfiction:

> “I’m Princess Celestia, of Equestria.” the alicorn said, “It’s nice to meet you. And I’m very sorry for your untimely demise.”

> “Heh. You’re telling me.” the Professor laughed, shaking his head. “I’m dead. I’m… dead. Do you know what that means?”

> “I have an inkling.” Princess Celestia said, wincing.

> “It means I don’t have to worry about even numbers anymore.” he said, nodding. “I don’t have to worry about probabilities anymore! I don’t have to worry about the upcoming war anymore! I don’t have to worry about anypony anymore!” he spread his hooves out at his sides, “I don’t have to do anything anymore! It’s beautiful!”

> “Yes, yes, I’m sure it is.” Princess Celestia said, nodding along.

> “Nothing matters now that I’m dead!” he cheered, “It’s great! I’m free! This is what it feels like to be liberated!”

> “I can see that.” she said.

> “I’m free from death!” he continued, “I’m free from taxes! I’m free from dictatorships! I’m free from flirting!” he laughed, “I’m free from everything! Isn’t it great?”

> “Sure, I guess.” Princess Celestia shrugged.

> “What do you think about all of this, Princess?” he asked.

> “About what?” she replied.

> “Well, I just thought you might have something to say about it all.” he told her.

> “What would you like me to say?” she responded.

> “Do you think death is awesome?” he questioned.

> “Well… no.” she shook her head, “But I think the passage to it is.”

> “Oh.” he said, “I see what you mean.”

Re: GPT-3 Creative Fiction

#54

Post by the8472 »

qayxc wrote: post #41
YeGoblynQueenne wrote: post #32

Earlier quoted context omitted.

Well, there is no formal definition of "understanding" in the context of CS, AI, or machine learning so anyone can claim anything they like, with respect to the term. For example, I have a thermos that keeps my coffee cold in the summer and hot in the winter. It u n d e r s t a n d s .

There are a number of NLP-tasks that aim to quantify understanding, e.g. textual entailment. No currently published model is even remotely close to human-level performance on all of these tasks. As long as there are no ways to properly query models, it's hard to qualify their level of understanding. It would help immensely if we could ask models for rules as in "why was the object labelled 'a car'" (in case of image…

https://arxiv.org/pdf/1811.03970.pdf

https://openaccess.thecvf.com/content_cvpr_2018/papers/Baumg...

Re: GPT-3 Creative Fiction

#55

Post by anoncake »

sillysaurusx wrote: post #2

Fine tuning GPT-3 is one of the biggest challenges, because it's behind an API. The weights aren't available to researchers, so we can't make it do anything it doesn't already do. But, that's fair. It's OpenAI's weights; they can keep them locked up if they want to. What caught my attention, though, is that supposedly OpenAI is working on a way to support fine-tuning. If you think about the logistics of that, it's a…

They can keep their weights secret, sure, but then they should change their name.

Re: GPT-3 Creative Fiction

#56

Post by runawaybottle »

mintplant wrote: post #52

It writes uncomfortably coherent and witty fatalist My Little Pony fanfiction: > “I’m Princess Celestia, of Equestria.” the alicorn said, “It’s nice to meet you. And I’m very sorry for your untimely demise.” > “Heh. You’re telling me.” the Professor laughed, shaking his head. “I’m dead. I’m… dead. Do you know what that means?” > “I have an inkling.” Princess Celestia said, wincing. > “It means I don’t have to worry a…

Now how do we get aspiring actors to take GPT3 seriously and act out a possible screenplay?

Hopefully one day it will generate startup business plans, and we’ll get people to take it seriously, we may not know the difference.

Re: GPT-3 Creative Fiction

#57

Post by qayxc »

the8472 wrote: post #54
qayxc wrote: post #41

Earlier quoted context omitted.

There are a number of NLP-tasks that aim to quantify understanding, e.g. textual entailment. No currently published model is even remotely close to human-level performance on all of these tasks. As long as there are no ways to properly query models, it's hard to qualify their level of understanding. It would help immensely if we could ask models for rules as in "why was the object labelled 'a car'" (in case of image…

https://arxiv.org/pdf/1811.03970.pdf https://openaccess.thecvf.com/content_cvpr_2018/papers/Baumg...

Both papers provide promising first steps in the right direction but are by no means solutions to the problem at hand. I mean, the second paper is even based on the premise that classification has already been done by human experts as a preparation step...

Re: GPT-3 Creative Fiction

#60

Post by silveroriole »

2bitencryption wrote: post #6

GPT's take on the navy seal copypasta, in the style of a KGB spy: "I have over 300 confirmed red scares." Haha, that is genuinely one of the funniest versions of that I've ever seen, human-generated or otherwise. That level of inference is really amazing.

I love that the Englishman one gets really confused about the meaning of the word “mate” and ends up as a Royal Navy pirate.
Post reply on HN