Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Does GPT-2 Know Your Phone Number?

bair.berkeley.edu

Post reply on HN
Print view View original

11–20 of 161 posts

Re: Does GPT-2 Know Your Phone Number?

#11

Post by hprotagonist »

dmm wrote: post #8
newman8r wrote: post #3

Playing with the AI dungeon a while back (on the GPT-2 mode) I was presented with a tilapia recipe, titled "Kittencal's Broiled Tilapia" - it sounded bizarre so I decided to do a google search and I found that it was directly pulled from from https://www.recipezazz.com/recipe/broiled-parmesan-tilapia-7... - the user who posted it was 'Kittencal'

So in terms of copyright, is GPT-2 a derived work of that recipe? Or generally are models derived works of their training data? It seems lots of people use training data from Flickr, like COCO, and then use the resulting model for commercial services.

i’ve been in meetings with lawyers where this issue was discussed. As of 2018 the answer was “not enough case law to know, hold tight it’s going to be weird one day!”

Re: Does GPT-2 Know Your Phone Number?

#12

Post by tiborsaas »

dmm wrote: post #8
newman8r wrote: post #3

Playing with the AI dungeon a while back (on the GPT-2 mode) I was presented with a tilapia recipe, titled "Kittencal's Broiled Tilapia" - it sounded bizarre so I decided to do a google search and I found that it was directly pulled from from https://www.recipezazz.com/recipe/broiled-parmesan-tilapia-7... - the user who posted it was 'Kittencal'

So in terms of copyright, is GPT-2 a derived work of that recipe? Or generally are models derived works of their training data? It seems lots of people use training data from Flickr, like COCO, and then use the resulting model for commercial services.

It cited it with the authors name, hardly a derived work :)

Re: Does GPT-2 Know Your Phone Number?

#13

Post by jcims »

fakedang wrote: post #9
jcims wrote: post #7

I was in a discord with someone that had direct access to GPT-3. We played Jeopardy with it, where we would take a wikipedia article about a person and use a snippet of the first paragraph as the prompt and ask GPT-3 who it was. It was very good at guessing the right person. I'm curious if one can use GPT-3 to do some clustering of people based on their writing. For example, if I take the writing of several diagnosed…

Guess it's because it was likely trained on Wikipedia data. After all, GPT-3 is no stranger to borrowing phraseology from verbose texts in the internet.

That was our conclusion as well, but that's still pretty powerful. The remarkable part for me was that it contextually knew that we were asking for the name of the subject that the text was about.

Re: Does GPT-2 Know Your Phone Number?

#14

Post by [deleted] »

tiborsaas wrote: post #10

> When Peter put his contact information online, it had an intended context of use. Unfortunately, applications built on top of GPT-2 are unaware of this context, and might thus unintentionally share Peter’s data in ways he did not intend. That's expected when you publish anything online, you lose control over the data.

[deleted]

Re: Does GPT-2 Know Your Phone Number?

#15

Post by est31 »

dmm wrote: post #8
newman8r wrote: post #3

Playing with the AI dungeon a while back (on the GPT-2 mode) I was presented with a tilapia recipe, titled "Kittencal's Broiled Tilapia" - it sounded bizarre so I decided to do a google search and I found that it was directly pulled from from https://www.recipezazz.com/recipe/broiled-parmesan-tilapia-7... - the user who posted it was 'Kittencal'

So in terms of copyright, is GPT-2 a derived work of that recipe? Or generally are models derived works of their training data? It seems lots of people use training data from Flickr, like COCO, and then use the resulting model for commercial services.

IANAL, but from my reading Article 3 of the EU copyright directive explicitly protects data mining for scientific research, and Article 4 enables everyone to use content for data mining whose rights have not been explicitly and machine readably reserved.

Re: Does GPT-2 Know Your Phone Number?

#17

Post by aimor »

jcims wrote: post #13
fakedang wrote: post #9

Earlier quoted context omitted.

Guess it's because it was likely trained on Wikipedia data. After all, GPT-3 is no stranger to borrowing phraseology from verbose texts in the internet.

That was our conclusion as well, but that's still pretty powerful. The remarkable part for me was that it contextually knew that we were asking for the name of the subject that the text was about.

But did it respond in the form of a question?

Re: Does GPT-2 Know Your Phone Number?

#18

Post by refactor_master »

tiborsaas wrote: post #10

> When Peter put his contact information online, it had an intended context of use. Unfortunately, applications built on top of GPT-2 are unaware of this context, and might thus unintentionally share Peter’s data in ways he did not intend. That's expected when you publish anything online, you lose control over the data.

Still doesn’t justify what could be perceived as borderline defamation.

Re: Does GPT-2 Know Your Phone Number?

#19

Post by px43 »

I've been saying this for years, but every post you make online, every unencrypted email, IM, text message, etc, will eventually end up getting sold off as training data for future machine learning projects.

Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleartext data they hold is going to get passed around to various data markets and end up incorporated into GPT-12 or whatever.

The moral of the story here isn't that companies need to stop storing data, or that we need to run ML researchers out of town. It's that people really need to start using the encryption technologies that were built decades ago to protect some of their most valuable assets, their mental model of the world. Otherwise these systems, which are being trained to extract as much value out of you and the ones you love as possible, will use this data you're giving them for free against you, and it'll be to late to do anything about it then.

Re: Does GPT-2 Know Your Phone Number?

#20

Post by lixtra »

est31 wrote: post #15
dmm wrote: post #8

Earlier quoted context omitted.

So in terms of copyright, is GPT-2 a derived work of that recipe? Or generally are models derived works of their training data? It seems lots of people use training data from Flickr, like COCO, and then use the resulting model for commercial services.

IANAL, but from my reading Article 3 of the EU copyright directive explicitly protects data mining for scientific research, and Article 4 enables everyone to use content for data mining whose rights have not been explicitly and machine readably reserved.

Edit: est31 and parent seem right and I stand corrected.

Wrong: I don’t think you‘re paraphrasing article 4 correctly. Both are about science/teaching exceptions. Not general exceptions. https://www.consilium.europa.eu/media/35373/st09134-en18.pdf pp 43

Post reply on HN