Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Employees are feeding sensitive data to ChatGPT, raising security fears

darkreading.com

Post reply on HN
Print view View original

61–70 of 355 posts

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#61

Post by ben_w »

meghan_rain wrote: post #14
humanistbot wrote: post #8

Earlier quoted context omitted.

From https://help.openai.com/en/articles/7039943-data-usage-for-c... : > You can request to opt out of having your content used to improve our services at any time by filling out this form ( https://docs.google.com/forms/d/1t2y-arKhcjlKc1I5ohl9Gb16t6S... ). This opt out will apply on a going-forward basis only. It goes to a google form, which is I guess better then them building their own survey platform from scratch…

I'd be worried this is also the "how to get banned from OpenAI in the near future" form. and if OpenAI retains a monopoly like Google does for search, you are basically screwed.

I'm old enough to remember when newspapers reported hackers being banned from using computers.

And IP pirates banned from using the internet. Actually, that one I remember I voted against my local MP after they passed a law to make that the norm.

We don't yet have a social, let alone legal, norm for antisocial use of LLMs; even with social media, government rules are playing catch-up with terms of service, and Facebook is old enough that if it was human it could now vote.

So, yes, likewise computers/internet/social media, being banned from an LLM if it's a monopoly is going to seriously harm people.

But that is likely to be a big "if". The architecture and the the core training data for GPT-3 isn't a secret, and that's already pretty impressive even if lesser than 3.5 and 4.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#62

Post by philsquared_ »

noncoml wrote: post #58
philsquared_ wrote: post #53

Earlier quoted context omitted.

Google takes your data and sells it. Literally making your data available to the highest bidder. Is OpenAI doing that? If Google existed in its current form during the early internet it would be classified in the same category as Bonzai Buddy. Spyware. That is what Google is. So I can very reasonably understand why people would trust OpenAI with data they wouldn't trust Google with. OpenAI hasn't spit in the face of…

> Google takes your data and sells it. Literally making your data available to the highest bidder. Even if they are not doing it now(?), what makes you think that they will not do so in the future? It's not like your data has an expiration date.

Because they are completely different business models. If OpenAI decides to become an advertising behemoth then I would show concern. Right now they use your data for training (when they use it).

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#63

Post by JohnFen »

w_for_wumbo wrote: post #7

This is the issue with a tool so powerful, you can't just tell people not to use it, or to use it responsibly. Because there's too much incentive for them to use it. If it saves hours of a persons' workday, and they're not seeing any of the harm caused from data leakage, there's no incentive for them to not use it. Which is why a private option is so critical. To not fight against human nature, means providing an abi…

There's a dev here who is using ChatGPT extensively in his work. The rest of the team is just waiting for him to get caught and fired. Sharing company data with unapproved external entities is very definitely a firing offense.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#64

Post by saulpw »

chaxor wrote: post #48
amelius wrote: post #34

Earlier quoted context omitted.

Uh, there's no sign of that yet.

[flagged]

> Think about how long it's taken tools like pandas to reach the point that it is now. That entire package can be built to the level it is now in a couple of days.

Let me hand you a mirror: You're absolutely and completely wrong

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#65

Post by smodo »

contravariant wrote: post #49
baxtr wrote: post #42

We went pretty quickly from: No way I’m giving Google any of my data! I will use 5 different browsers in incognito mode and never log in. To -> Sure I will login with my name and email and feed you as much of my most personal thoughts and data as I can dear ChatGPT!

Any examples where those two were the same person? Because both types of people have always existed. Heck, lack of vigilance among the ancient Greeks is what put the Trojan in Trojan horse.

It was a lack of vigilance among the Trojans, actually. The Greeks did the burning an pillaging. So uh OpenAI is the Greeks, ChatGPT is the horse and Microsoft is king Menelaos or something. Achilles is dead, but he did make TempleOS.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#66

Post by pedrosorio »

chaxor wrote: post #48
amelius wrote: post #34

Earlier quoted context omitted.

Uh, there's no sign of that yet.

[flagged]

> Think about how long it's taken tools like pandas to reach the point that it is now. That entire package can be built to the level it is now in a couple of days.

I am having trouble parsing this statement. You're saying a person equipped with chatGPT trained on data prior to December 2007 (the month before the initial pandas release) could have put together the entire pandas library in a couple of days?

That seems obviously wrong, starting with the fact that one would need to know "what" to build in the first place. If you're saying that chatGPT in 2023 can spit out pandas library source code when asked for it directly, that's obvious.

Somewhere between the impossible statement and the obvious statement I made above, there must be something interesting that you were trying to claim. What was it?

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#68

Post by jankeymeulen »

philsquared_ wrote: post #53
baxtr wrote: post #42

We went pretty quickly from: No way I’m giving Google any of my data! I will use 5 different browsers in incognito mode and never log in. To -> Sure I will login with my name and email and feed you as much of my most personal thoughts and data as I can dear ChatGPT!

Google takes your data and sells it. Literally making your data available to the highest bidder. Is OpenAI doing that? If Google existed in its current form during the early internet it would be classified in the same category as Bonzai Buddy. Spyware. That is what Google is. So I can very reasonably understand why people would trust OpenAI with data they wouldn't trust Google with. OpenAI hasn't spit in the face of…

Not really. Even the most evil Google one can imagine would realise "your data" is the most valuable thing they possess, selling it would be bad for business. They're selling ads to the highest bidder who's looking for someone with a profile based on your data, but not your data itself.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#69

Post by JohnFen »

philsquared_ wrote: post #53
baxtr wrote: post #42

We went pretty quickly from: No way I’m giving Google any of my data! I will use 5 different browsers in incognito mode and never log in. To -> Sure I will login with my name and email and feed you as much of my most personal thoughts and data as I can dear ChatGPT!

Google takes your data and sells it. Literally making your data available to the highest bidder. Is OpenAI doing that? If Google existed in its current form during the early internet it would be classified in the same category as Bonzai Buddy. Spyware. That is what Google is. So I can very reasonably understand why people would trust OpenAI with data they wouldn't trust Google with. OpenAI hasn't spit in the face of…

> I can very reasonably understand why people would trust OpenAI with data they wouldn't trust Google with. OpenAI hasn't spit in the face of its users yet.

In other words, having been burnt once by touching a flame, the conclusion these people draw is that the problem was with that particular flame and they're fine with reaching for a different one?

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#70

Post by JohnFen »

jankeymeulen wrote: post #68
philsquared_ wrote: post #53

Earlier quoted context omitted.

Google takes your data and sells it. Literally making your data available to the highest bidder. Is OpenAI doing that? If Google existed in its current form during the early internet it would be classified in the same category as Bonzai Buddy. Spyware. That is what Google is. So I can very reasonably understand why people would trust OpenAI with data they wouldn't trust Google with. OpenAI hasn't spit in the face of…

Not really. Even the most evil Google one can imagine would realise "your data" is the most valuable thing they possess, selling it would be bad for business. They're selling ads to the highest bidder who's looking for someone with a profile based on your data, but not your data itself.

True, but that's not actually any better. And it still counts as selling your data, just indirectly.
Post reply on HN