Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Employees are feeding sensitive data to ChatGPT, raising security fears

darkreading.com

Post reply on HN
Print view View original

81–90 of 355 posts

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#81

Post by yathrowaway01 »

JohnFen wrote: post #63
w_for_wumbo wrote: post #7

This is the issue with a tool so powerful, you can't just tell people not to use it, or to use it responsibly. Because there's too much incentive for them to use it. If it saves hours of a persons' workday, and they're not seeing any of the harm caused from data leakage, there's no incentive for them to not use it. Which is why a private option is so critical. To not fight against human nature, means providing an abi…

There's a dev here who is using ChatGPT extensively in his work. The rest of the team is just waiting for him to get caught and fired. Sharing company data with unapproved external entities is very definitely a firing offense.

Glad I work for a company where the CEO pays for everyones ChatGPT Plus for the devs. If you think your code is special then you're wrong.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#83

Post by msm_ »

Ensorceled wrote: post #56
chaxor wrote: post #48

Earlier quoted context omitted.

[flagged]

> Think about how long it's taken tools like pandas to reach the point that it is now. That entire package can be built to the level it is now in a couple of days. I don't think that is true at all. Do you have an example of a significant project being duplicated in days, or even months, with ANY of these tools? By significant, I mean something on the order of pandas which you claimed.

And this is completely ignoring the fact, that the real hard problem is the design. Spitting boilerplate code is not. How pandas could be designed perfectly in one afternoon (and generated with GPT) is beyond my comprehension.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#84

Post by dragonwriter »

philsquared_ wrote: post #53
baxtr wrote: post #42

We went pretty quickly from: No way I’m giving Google any of my data! I will use 5 different browsers in incognito mode and never log in. To -> Sure I will login with my name and email and feed you as much of my most personal thoughts and data as I can dear ChatGPT!

Google takes your data and sells it. Literally making your data available to the highest bidder. Is OpenAI doing that? If Google existed in its current form during the early internet it would be classified in the same category as Bonzai Buddy. Spyware. That is what Google is. So I can very reasonably understand why people would trust OpenAI with data they wouldn't trust Google with. OpenAI hasn't spit in the face of…

> Google takes your data and sells it. Literally making your data available to the highest bidder.

No, Google takes money to present ads to people of different demographics, and uses your data to do that. It doesn’t sell your data, which is, in fact their competitive edge in ads – selling your data would be selling the cow when they’d prefer to sell the milk.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#85

Post by jackson1442 »

wantsanagent wrote: post #78

We saw these same fears with the release of Gmail. Why would you trust your email to Google?!! Aren't they going to train their spam filters on all your data? Aren't they going to sell it, or use it to sell you ads? Corporations constantly put their most sensitive data in 3rd party tools. The executive in the article was probably copying his company strategy from Google docs. Yes, there are good reasons for concern,…

I think this is different in that ChatGPT is expressly using your data as training in a probabilistic model. This means:

* Their contractors can (and do!) see your chat data to tune the model

* If the model is trained on your confidential data, it may start returning this data to other users (as we've seen with Github Copilot regurgitating licensed software)

* The site even _tells you_ not to put confidential data in for these reasons.

Until OpenAI makes a version that you can stick on a server in your own datacenter, I wouldn't trust it with anything confidential.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#86

Post by bcrosby95 »

comment_ran wrote: post #24
cuuupid wrote: post #5

We block ChatGPT, as do most federal contractors. I think it’s a horrible exploit waiting to happen: - there’s no way they’re manually scrubbing out sensitive data so its bound to spill out from the training data when prompting the model - OpenAI is openly storing all this data they’re collecting to the extent that they’ve had several leaks now where people can see others’ conversations and data. We are one step away…

If your competitor use ChatGPT to compete with you and they're 10x productive than yours, are you still willing to insist? If the productive is 100x, will you?

Security and privacy should be table stakes. Speaking for my country, we needs privacy laws with teeth to punish bad actors from shitting people's private information where ever they want in the name of a dollar.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#87

Post by arcticfox »

causality0 wrote: post #73
brobdingnagians wrote: post #37

Earlier quoted context omitted.

It might be just as likely that ChapGPT will cause a mistake like Knight Capital because no one bothered to thoroughly verify the AI's looks-good-but-deeply-flawed answer, and the two aren't mutually exclusive possibilities.

Right. I've had ChatGPT completely fail at something as simple as writing a batch file to find and replace text in a text file.

Sure, but humans do that all the time as well

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#88

Post by tiborsaas »

syntaxing wrote: post #22

I’m curious if anyone’s employer has set up their own LLM. My employer has a couple of A100 sitting around which could easily host a couple instance of 65B LLaMA or Alpaca. Convincing upper management to allow me is the hard part.

Team up with someone from sales, marketing :)

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#89

Post by JohnFen »

yathrowaway01 wrote: post #81
JohnFen wrote: post #63

Earlier quoted context omitted.

There's a dev here who is using ChatGPT extensively in his work. The rest of the team is just waiting for him to get caught and fired. Sharing company data with unapproved external entities is very definitely a firing offense.

Glad I work for a company where the CEO pays for everyones ChatGPT Plus for the devs. If you think your code is special then you're wrong.

That entirely depends on the code. It's not that the code is special, it's that the code can reveal things that are competitive advantages (future plans, etc.)

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#90

Post by arcticfox »

JohnFen wrote: post #63
w_for_wumbo wrote: post #7

This is the issue with a tool so powerful, you can't just tell people not to use it, or to use it responsibly. Because there's too much incentive for them to use it. If it saves hours of a persons' workday, and they're not seeing any of the harm caused from data leakage, there's no incentive for them to not use it. Which is why a private option is so critical. To not fight against human nature, means providing an abi…

There's a dev here who is using ChatGPT extensively in his work. The rest of the team is just waiting for him to get caught and fired. Sharing company data with unapproved external entities is very definitely a firing offense.

If they're more productive by doing it, I think it's an equal chance said dev gets promoted.
Post reply on HN