Live data from Hacker News

Employees are feeding sensitive data to ChatGPT, raising security fears

darkreading.com

31–40 of 355 posts

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#31
This cycle happens regularly and it seems often times the service provider wises up and charges for extra controls.

Yammer pre-Microsoft and nowadays Blind — lots of “insider” information seemingly posted.

As usage goes up the target size, and opportunity cost, both go up.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#32
post #21

Earlier quoted context omitted.

Inform us when you figured out a way to host something with the quality of ChatGPT internally :-)

Even if we had a 100% private ChatGPT instance, it wouldn't fully cover our internal use case. There is way more context to our business than can fit in 4/8/32k tokens. Even if we could fit the 32k token budget, it would be very expensive to run like this 24/7. Fine-tuning a base model is the only practical/affordable path for us.

You can retrieve information on demand based on what the user is asking, like this: https://github.com/openai/chatgpt-retrieval-plugin

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#33
This is nothing new at all. How many people have Grammarly plugins installed? They are advertising aggressively, so I'd think it is the new hotness. Don't tell me Grammarly is not hoovering up all of the Slack, Word, Docs, and Gmail data that everyone sends it, and holding on for some future purpose. We'll see.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#34
post #5

We block ChatGPT, as do most federal contractors. I think it’s a horrible exploit waiting to happen: - there’s no way they’re manually scrubbing out sensitive data so its bound to spill out from the training data when prompting the model - OpenAI is openly storing all this data they’re collecting to the extent that they’ve had several leaks now where people can see others’ conversations and data. We are one step away…

If your competitor use ChatGPT to compete with you and they're 10x productive than yours, are you still willing to insist? If the productive is 100x, will you?

Uh, there's no sign of that yet.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#36

Wouldn't it be trivial to add a "read-only" mode to the LLM's operation, where it uses stored knowledge to answer queries but doesn't ingest new knowledge from those queries?

Why isn't it read-only by default? it's not even connected to the internet

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#37
post #5

We block ChatGPT, as do most federal contractors. I think it’s a horrible exploit waiting to happen: - there’s no way they’re manually scrubbing out sensitive data so its bound to spill out from the training data when prompting the model - OpenAI is openly storing all this data they’re collecting to the extent that they’ve had several leaks now where people can see others’ conversations and data. We are one step away…

If your competitor use ChatGPT to compete with you and they're 10x productive than yours, are you still willing to insist? If the productive is 100x, will you?

It might be just as likely that ChapGPT will cause a mistake like Knight Capital because no one bothered to thoroughly verify the AI's looks-good-but-deeply-flawed answer, and the two aren't mutually exclusive possibilities.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#38

In my experience most corporate employees just take the path of least resistance. It is not uncommon for people to paste non public data into websites just to do json formatting, and paste base64 strings to random websites just to decode them. So just telling people not to do something won't accomplish much. Most corporate employees also somehow think they know better than the policy. Any company that doesn't want to…

> and any website serving as a wrapper over it

I agree this would be a good move, but it's going to be harder and harder to do that definitively.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#39
I noticed this too, this is why I'm working on a startup that lets you train your data internally through a self-hosted OSS LLM product. It's going to start off with just reading emails for now until we can integrate with other products too, like spreadsheets, Airtable, databases, etc. Basically an OSS version of OpenAI ChatGPT plugins, I suppose. If you're interested, message my at my email in my profile.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#40

In my experience most corporate employees just take the path of least resistance. It is not uncommon for people to paste non public data into websites just to do json formatting, and paste base64 strings to random websites just to decode them. So just telling people not to do something won't accomplish much. Most corporate employees also somehow think they know better than the policy. Any company that doesn't want to…

A while back I got to hear about how the IT team running my then-employer's internal time reporting tool was sending all the usage data through Google Analytics and how neat that was for them to look at :\ .

I shudder to think what they are doing now.

Post reply on HN