Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Does GPT-2 Know Your Phone Number?

bair.berkeley.edu

Post reply on HN
Print view View original

71–80 of 161 posts

Re: Does GPT-2 Know Your Phone Number?

#71

Post by m463 »

dmm wrote: post #8
newman8r wrote: post #3

Playing with the AI dungeon a while back (on the GPT-2 mode) I was presented with a tilapia recipe, titled "Kittencal's Broiled Tilapia" - it sounded bizarre so I decided to do a google search and I found that it was directly pulled from from https://www.recipezazz.com/recipe/broiled-parmesan-tilapia-7... - the user who posted it was 'Kittencal'

So in terms of copyright, is GPT-2 a derived work of that recipe? Or generally are models derived works of their training data? It seems lots of people use training data from Flickr, like COCO, and then use the resulting model for commercial services.

Ethical companies make sure they have rights to the training data before making models.

That said, now a lot of privacy policies make sense.

ALSO, it makes me wonder about "Your call is recorded for training purposes"... is it a coincidence or is it very carefully worded?

Re: Does GPT-2 Know Your Phone Number?

#72

Post by why_only_15 »

est31 wrote: post #16

One important corollary of this is that "privacy respecting" federated learning schemes [0] where you train a model locally with your data and only upload the deltas might leak your private data after all. [0]: https://arxiv.org/abs/1602.05629

In practice you add large gaussians to the deltas, which gives you reasonably strong guarantees.

Re: Does GPT-2 Know Your Phone Number?

#73

Post by minimaxir »

rexreed wrote: post #35

Sorry if this is a n00b question, but how does one go about getting a hold of the GPT-2 model? I know that GPT-3 is only available for consumption on a pay-per-use API model.

The GPT-2 weights were released by OpenAI when GPT-2 was released. (https://github.com/openai/gpt-2)

Around that time (since no one else was doing it) I released a wrapper to streamline that code and make it much easier to finetune on your own data. (https://github.com/minimaxir/gpt-2-simple)

Nowadays, the easiest way to interact with GPT-2 is to use the transformers library (https://github.com/huggingface/transformers), of which I've created a much better library for GPT-2 that leverages it. (https://github.com/minimaxir/aitextgen)

Re: Does GPT-2 Know Your Phone Number?

#74

Post by ClumsyPilot »

tiborsaas wrote: post #10

> When Peter put his contact information online, it had an intended context of use. Unfortunately, applications built on top of GPT-2 are unaware of this context, and might thus unintentionally share Peter’s data in ways he did not intend. That's expected when you publish anything online, you lose control over the data.

So copying an internet-published trailer of a Marvel movie is a crime, but my privacy is up for grabs.

Re: Does GPT-2 Know Your Phone Number?

#75

Post by kevincox »

aboringusername wrote: post #50

I'm not even sure why people have phone numbers at all these days, the entire telephony system has been hijacked to hell (so much data collection from just owning a phone number). What you should be doing is replacing no less than yearly any numbers you have, also email addresses and anything within your control (changing physical address is much more difficult). You may even consider changing your legal name if that…

We should really be giving a unique identifier to each contact. Then we can revoke addresses that have been leaked. Of course for phone number this is impractical. However for email this could work.

Re: Does GPT-2 Know Your Phone Number?

#76

Post by grawprog »

ClumsyPilot wrote: post #68
ojnabieoot wrote: post #39

Earlier quoted context omitted.

> The moral of the story here isn't that companies need to stop storing data, or that we need to run ML researchers out of town. There is a lot of space between “user data and ML research on that data needs to be closely regulated” and “run the ML researchers out of town.” This uncharitable exaggeration makes critics sound like an uninformed mob and closes yourself off to legitimate ideas. This directly leads to logi…

Its amazing that such a sober take on the issue is getting downvoted without a single counterargument

Probably because the comment can be mostly summed up to:

'The majority of humans are idiots who need to be protected from themselves by the government.'

Re: Does GPT-2 Know Your Phone Number?

#77

Post by chrismorgan »

px43 wrote: post #19

I've been saying this for years, but every post you make online, every unencrypted email, IM, text message, etc, will eventually end up getting sold off as training data for future machine learning projects. Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleart…

> people really need to start using the encryption technologies […] Otherwise these systems, which are being trained to extract as much value out of you […] as possible, will use this data […] against you, […]

You are proposing a technical solution to a social problem. That pretty much never works.

Re: Does GPT-2 Know Your Phone Number?

#78

Post by fastball »

ClumsyPilot wrote: post #70
fastball wrote: post #56

Earlier quoted context omitted.

End-to-end encryption is a possible solution to some of this, no?

I can't use a single public service with E2E encrypted email, whether thats private or commerial. General state of encryption technology is that it's arcane and unusable outside of like a couple of chat apps

Email you can encrypt with PGP tho?

The problem isn't really the technology, it's that the people you are interacting with on the internet don't care about privacy as much as you do, and obviously when it comes to keeping things private, everyone has to participate.

Re: Does GPT-2 Know Your Phone Number?

#79

Post by chrismorgan »

grawprog wrote: post #76
ClumsyPilot wrote: post #68

Earlier quoted context omitted.

Its amazing that such a sober take on the issue is getting downvoted without a single counterargument

Probably because the comment can be mostly summed up to: 'The majority of humans are idiots who need to be protected from themselves by the government.'

It’s not that humans need to be protected from themselves (individually), but that they need to be protected from other unscrupulous people, because computers are empowering the unscrupulous (and even the accidentally unscrupulous) more than they are empowering the common person. I broadly agree with ojnabieoot.

Re: Does GPT-2 Know Your Phone Number?

#80

Post by ClumsyPilot »

aboringusername wrote: post #50

I'm not even sure why people have phone numbers at all these days, the entire telephony system has been hijacked to hell (so much data collection from just owning a phone number). What you should be doing is replacing no less than yearly any numbers you have, also email addresses and anything within your control (changing physical address is much more difficult). You may even consider changing your legal name if that…

Because telephony system is actually reliable in case of emergencies and regulated
Post reply on HN