Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Does GPT-2 Know Your Phone Number?

bair.berkeley.edu

Post reply on HN
Print view View original

91–100 of 161 posts

Re: Does GPT-2 Know Your Phone Number?

#91

Post by st1x7 »

visarga wrote: post #41
px43 wrote: post #19

I've been saying this for years, but every post you make online, every unencrypted email, IM, text message, etc, will eventually end up getting sold off as training data for future machine learning projects. Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleart…

Maybe this data will be used to 'upload' you in a virtual world after the singularity. It might be your second life.

Even in the science fiction version of this, we're still talking about a copy. It's not you, you can't leave your body or be uploaded. It's just a digital copy that looks like you.

Re: Does GPT-2 Know Your Phone Number?

#92

Post by ojnabieoot »

grawprog wrote: post #85
chrismorgan wrote: post #79

Earlier quoted context omitted.

It’s not that humans need to be protected from themselves (individually), but that they need to be protected from other unscrupulous people , because computers are empowering the unscrupulous (and even the accidentally unscrupulous) more than they are empowering the common person. I broadly agree with ojnabieoot.

So why not teach people so they can empower themselves instead of making them rely on yet other people, who may or not be scrupulous themselves for protection? Because the government is always scrupulous and trustworthy...and nobody that's ever said trust us we'll protect you has lied...

Again: you could make the same argument against the fire department (“don’t rely on the government, learn fire suppression yourself”) or dangerous pharmaceuticals (“the peer-reviewed articles are out there, you just need to learn how to read them”), or protection against assault and theft, or protection against dangerous wild animals, etc etc. In general your argument is “proving” way too much and doesn’t say anything useful.

Nobody is disputing that the government can be corrupt, and at its best will be incapable of protecting everyone from everything. And if you are sincerely anarchist then that’s more of an ideological dispute beyond the scope of this comment.

But I suspect that you actually support regulation around food and medicine, since “a fatal case of salmonella is a small price to pay to make sure we don’t rely on the government” isn’t actually a good argument. And, unlike people who are ignorant about computer technology, you probably have empathy and understanding for people who are ignorant about whether the ground beef they are purchasing is actually safe to eat. You would not be sympathetic to a libertarian food safety specialist came in and said “well I can tell that the ground beef is unsafe, why not teach everyone my skills so they can defend themselves?”

The idea that the government can protect people when it comes to health, medicine, transportation, and personal property... but NOT when it comes to privacy, is just not coherent.

Re: Does GPT-2 Know Your Phone Number?

#93

Post by simplify »

jakear wrote: post #51
ben_w wrote: post #46

Earlier quoted context omitted.

It depends what you mean by “free will” — the phrase “free will” is as ill-defined as “common sense” and “consciousness”. I take the view that ∀ x ∈ , Has(x, humans) ≡ Has(x, AI)

I agree with your claim. I also believe many to see “free will”/consciousness/etc as that certain je ne sais quoi that separates the human experience from that of computers: ∀ x ∈ , Has(x, humans) ≡ ~Has(x, AI) For these to both be true, becomes empty. Thus I argue we have none. Edit, or rather it’s meaningless to argue if we have any or not, as it cannot be defined.

> or rather it’s meaningless to argue if we have any or not, as it cannot be defined.

This sums up my view too. Can't argue about it if you can't define it.

Re: Does GPT-2 Know Your Phone Number?

#94

Post by agumonkey »

px43 wrote: post #19

I've been saying this for years, but every post you make online, every unencrypted email, IM, text message, etc, will eventually end up getting sold off as training data for future machine learning projects. Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleart…

Data rots. What was true 10 years ago about me is not necessary the case now.

Re: Does GPT-2 Know Your Phone Number?

#95

Post by commandpaul »

Filligree wrote: post #33
commandpaul wrote: post #5

I've been playing with a writing tool shortlyread.com which purpotedly uses the GPT3 API. I had a similar experience in its responses to a lot of my prompts containing text verbatim from many sources and sometimes even going on to output personally identifying about persons related to the original text.

Took a look at that. It's better at being a text editor, in that you can click the text and edit it! (Sweet relief.) But it's missing the world-info feature from AI Dungeon, and without that I don't think it's practical to write anything long-form.

It actually does have that feature , it's tucked away in the probe panel.

Re: Does GPT-2 Know Your Phone Number?

#96

Post by courtf »

agumonkey wrote: post #94
px43 wrote: post #19

I've been saying this for years, but every post you make online, every unencrypted email, IM, text message, etc, will eventually end up getting sold off as training data for future machine learning projects. Every company stores this stuff for ages, and the value of candid conversation data just keeps increasing. Eventually these companies are either going to get hacked, get bought, or go bankrupt, and all the cleart…

Data rots. What was true 10 years ago about me is not necessary the case now.

It's one of the biggest lies in tech right now, that all this user data is some untapped gold mine, as if text on the internet is the most important measure of human behavior. It's all going to end up rotting on backups while the marketing department spins yarns about the amazing AI that's going to spring forth any day now from a pile of tweets.

It's like trying to build a dog by hanging around the park collecting turds.

Re: Does GPT-2 Know Your Phone Number?

#97

Post by ben_w »

jakear wrote: post #51
ben_w wrote: post #46

Earlier quoted context omitted.

It depends what you mean by “free will” — the phrase “free will” is as ill-defined as “common sense” and “consciousness”. I take the view that ∀ x ∈ , Has(x, humans) ≡ Has(x, AI)

I agree with your claim. I also believe many to see “free will”/consciousness/etc as that certain je ne sais quoi that separates the human experience from that of computers: ∀ x ∈ , Has(x, humans) ≡ ~Has(x, AI) For these to both be true, becomes empty. Thus I argue we have none. Edit, or rather it’s meaningless to argue if we have any or not, as it cannot be defined.

Yes, that also fits my observations of such arguments.

Re: Does GPT-2 Know Your Phone Number?

#98

Post by gjs278 »

barrkel wrote: post #30
tiborsaas wrote: post #10

> When Peter put his contact information online, it had an intended context of use. Unfortunately, applications built on top of GPT-2 are unaware of this context, and might thus unintentionally share Peter’s data in ways he did not intend. That's expected when you publish anything online, you lose control over the data.

Ah yes. And if your name is included in an accusation of murder, well, I guess you shouldn't have published your name. This is infantile reverse justification from an end. GPT style corpuses are clearly problematic without a lot more smarts on figuring out what's appropriate and what's not.

barrkel is a murderer. he also attacked my dog once. go problematic somewhere else. I hope this data ends up in gpt-4.

Re: Does GPT-2 Know Your Phone Number?

#99

Post by agumonkey »

courtf wrote: post #96
agumonkey wrote: post #94

Earlier quoted context omitted.

Data rots. What was true 10 years ago about me is not necessary the case now.

It's one of the biggest lies in tech right now, that all this user data is some untapped gold mine, as if text on the internet is the most important measure of human behavior. It's all going to end up rotting on backups while the marketing department spins yarns about the amazing AI that's going to spring forth any day now from a pile of tweets. It's like trying to build a dog by hanging around the park collecting tu…

is the data market a bubble ?

Re: Does GPT-2 Know Your Phone Number?

#100

Post by boulos »

kevinmchugh wrote: post #27
dmm wrote: post #8

Earlier quoted context omitted.

So in terms of copyright, is GPT-2 a derived work of that recipe? Or generally are models derived works of their training data? It seems lots of people use training data from Flickr, like COCO, and then use the resulting model for commercial services.

Recipes aren't typically copyrightable In general, I think the question is unsettled

The “recipe” itself (the ingredients, the steps) isn’t copyrightable but the surrounding text of a “recipe” can be considered copyrightable.

So you can happily reproduce the statements of facts and the process. You can’t include someone’s anecdotes about how their grandfather liked to make the dish for New Year’s Eve.

Post reply on HN