Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Does GPT-2 Know Your Phone Number?

bair.berkeley.edu

Post reply on HN
Print view View original

41–50 of 161 posts

Re: Does GPT-2 Know Your Phone Number?

#41

Post by visarga »

px43 wrote: post #19

I've been saying this for years, but every post you make online, every unencrypted email, IM, text message, etc, will eventually end up getting sold off as training data for future machine learning projects. Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleart…

Maybe this data will be used to 'upload' you in a virtual world after the singularity. It might be your second life.

Re: Does GPT-2 Know Your Phone Number?

#42

Post by hyperpape »

jrockway wrote: post #31
px43 wrote: post #19

I've been saying this for years, but every post you make online, every unencrypted email, IM, text message, etc, will eventually end up getting sold off as training data for future machine learning projects. Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleart…

Isn't that how humans work? Sometimes I wonder if I have free will and sentience, or if I am just stringing words together based on some probability function. I've no doubt taken into account copyrighted works and personal information when training my built-in neural network. The examples the article gives like "misremembering" the murder as the murder victim sounds like something a person would do. Knowing verbatim…

Of course it isn't how the human mind works.

You can ask a person "did you come up with that sentence, or is it something you read?" And they can answer that question. The answer isn't perfectly reliable, but it isn't completely unreliable either. You can't do that with GPT-2/GPT-3.

Big picture: the human mind is a machine of sorts. It's not the same kind of machine as any form of machine learning we've developed so far.

Re: Does GPT-2 Know Your Phone Number?

#43

Post by politician »

tiborsaas wrote: post #10

> When Peter put his contact information online, it had an intended context of use. Unfortunately, applications built on top of GPT-2 are unaware of this context, and might thus unintentionally share Peter’s data in ways he did not intend. That's expected when you publish anything online, you lose control over the data.

Except for copyright, which works completely differently to magically protect your rights for up to 70 years after your death.

Re: Does GPT-2 Know Your Phone Number?

#44

Post by visarga »

I was expecting a bloom filter based solution to block verbatim reproduction of training data. They just need to hash the sensitive n-grams (hopefully, a small part of the whole dataset) and store one bit per hash.

Alternatively, they could do something like GAN and have a 'discriminator' classify if a sample is natural or synthetic. Then, at inference, condition to be original.

So, verbatim training data reproduction - I don't think it's going to be a problem, I think the author is making too much of it.

On the contrary, let's have this knob exposed and we could set it anywhere between original and copycat, at deployment time. Maybe you want to know the lyrics of a song, or how to fix a Python error (copycat model is best). Maybe you want an 'original' essay for homework inspiration. Who knows? But the model should know PII and copyrighted text when it sees it.

Re: Does GPT-2 Know Your Phone Number?

#45

Post by flatline »

visarga wrote: post #41
px43 wrote: post #19

I've been saying this for years, but every post you make online, every unencrypted email, IM, text message, etc, will eventually end up getting sold off as training data for future machine learning projects. Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleart…

Maybe this data will be used to 'upload' you in a virtual world after the singularity. It might be your second life.

When thinking about this, you have to ask, who will profit, and how? It doesn’t seem like a clone of your brain running in a simulation is going to be of much advantage to you from the current industry incentives. Maybe if you’re rich?

Re: Does GPT-2 Know Your Phone Number?

#46

Post by ben_w »

jakear wrote: post #36
jrockway wrote: post #31

Earlier quoted context omitted.

Isn't that how humans work? Sometimes I wonder if I have free will and sentience, or if I am just stringing words together based on some probability function. I've no doubt taken into account copyrighted works and personal information when training my built-in neural network. The examples the article gives like "misremembering" the murder as the murder victim sounds like something a person would do. Knowing verbatim…

It’s my understanding that under our current scientific understanding of the mind, we cannot have “free will”. Where would it come from? All science knows is that neurons receive inputs from sensors, mixes them together (with some quantum randomness sprinkled in), and eventually actuates muscles to produce outputs, exactly as GPT. Thus “free will” must come from some sort of faith. Either it was given to us by “God”,…

It depends what you mean by “free will” — the phrase “free will” is as ill-defined as “common sense” and “consciousness”.

I take the view that ∀ x ∈ , Has(x, humans) ≡ Has(x, AI)

Re: Does GPT-2 Know Your Phone Number?

#48

Post by ben_w »

hyperpape wrote: post #42
jrockway wrote: post #31

Earlier quoted context omitted.

Isn't that how humans work? Sometimes I wonder if I have free will and sentience, or if I am just stringing words together based on some probability function. I've no doubt taken into account copyrighted works and personal information when training my built-in neural network. The examples the article gives like "misremembering" the murder as the murder victim sounds like something a person would do. Knowing verbatim…

Of course it isn't how the human mind works. You can ask a person "did you come up with that sentence, or is it something you read?" And they can answer that question. The answer isn't perfectly reliable, but it isn't completely unreliable either. You can't do that with GPT-2/GPT-3. Big picture: the human mind is a machine of sorts. It's not the same kind of machine as any form of machine learning we've developed so…

> The answer isn't perfectly reliable, but it isn't completely unreliable either.

How would we be able to tell how reliable it is in general?

"""The left brain of people whose hemispheres have been disconnected has been observed to invent explanations for body movement initiated by the opposing (right) hemisphere, perhaps based on the assumption that their actions are consciously willed.""" - https://en.wikipedia.org/wiki/Neuroscience_of_free_will#Rela...

Re: Does GPT-2 Know Your Phone Number?

#49

Post by ben_w »

flatline wrote: post #45
visarga wrote: post #41

Earlier quoted context omitted.

Maybe this data will be used to 'upload' you in a virtual world after the singularity. It might be your second life.

When thinking about this, you have to ask, who will profit, and how? It doesn’t seem like a clone of your brain running in a simulation is going to be of much advantage to you from the current industry incentives. Maybe if you’re rich?

If you make some fairly plausible assumptions about Moores law (and equivalents), the simulations are cheaper than the meat bodies before mid-century.

• https://worldbuilding.stackexchange.com/questions/51746/when...

• https://kitsunesoftware.wordpress.com/2018/10/01/pocket-brai...

Re: Does GPT-2 Know Your Phone Number?

#50

Post by aboringusername »

I'm not even sure why people have phone numbers at all these days, the entire telephony system has been hijacked to hell (so much data collection from just owning a phone number).

What you should be doing is replacing no less than yearly any numbers you have, also email addresses and anything within your control (changing physical address is much more difficult).

You may even consider changing your legal name if that's a consideration depending on what Google has on you.

Post reply on HN