Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Employees are feeding sensitive data to ChatGPT, raising security fears

darkreading.com

Post reply on HN
Print view View original

21–30 of 355 posts

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#21

Post by bob1029 »

meghan_rain wrote: post #13
bob1029 wrote: post #11

We published an internal policy for AI tools last week. The basic theme is: "We see the value too, but please don't copypasta our intellectual property until we get a chance to stand up something internal." We've granted some exceptions to the team responsible for determining how to stand up something internal. Lots of shooting in the dark going on here, so I figured we would need some divulgence of our IP against pu…

Inform us when you figured out a way to host something with the quality of ChatGPT internally :-)

Even if we had a 100% private ChatGPT instance, it wouldn't fully cover our internal use case.

There is way more context to our business than can fit in 4/8/32k tokens. Even if we could fit the 32k token budget, it would be very expensive to run like this 24/7. Fine-tuning a base model is the only practical/affordable path for us.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#23

Post by dannyobrien »

sigstoat wrote: post #2

when it first came out and my boss was behind himself about how cool it was, he was feeding it all of his emails with other businesses to have it clean them up. boggled my mind.

do those other businesses use gmail? does your company?

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#24

Post by comment_ran »

cuuupid wrote: post #5

We block ChatGPT, as do most federal contractors. I think it’s a horrible exploit waiting to happen: - there’s no way they’re manually scrubbing out sensitive data so its bound to spill out from the training data when prompting the model - OpenAI is openly storing all this data they’re collecting to the extent that they’ve had several leaks now where people can see others’ conversations and data. We are one step away…

If your competitor use ChatGPT to compete with you and they're 10x productive than yours, are you still willing to insist? If the productive is 100x, will you?

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#25

Post by visarga »

meghan_rain wrote: post #13
bob1029 wrote: post #11

We published an internal policy for AI tools last week. The basic theme is: "We see the value too, but please don't copypasta our intellectual property until we get a chance to stand up something internal." We've granted some exceptions to the team responsible for determining how to stand up something internal. Lots of shooting in the dark going on here, so I figured we would need some divulgence of our IP against pu…

Inform us when you figured out a way to host something with the quality of ChatGPT internally :-)

You can use chatGPT inside Azure, like any other service. It's not the same one used by OpenAI, and there are different guarantees.

> ChatGPT is now available in Azure OpenAI Service

https://azure.microsoft.com/en-us/blog/chatgpt-is-now-availa...

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#26

Post by Mizoguchi »

"In one case, an executive cut and pasted the firm's 2023 strategy document into ChatGPT and asked it to create a PowerPoint deck."

There's really not much you can do here. This is complete lack of very basic common sense. Having someone like this in your business, particularly at the executive level, is a liability regardless of ChatGPT.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#27

Post by rrdharan »

yawnxyz wrote: post #16

I think there's more fear of OpenAI leaking data than say, Airtable or Notion or Github or AWS/S3 or Cloudflare or Vercel or some other company that has gobs of a company's data. Microsoft also has gobs of data: anything on Office and Outlook is your company data — but the fear that they'll leak (intentional or accidental) is somehow more contained. If we want to be intellectually honest with ourselves, we can either…

1. Azure has the worst security of the major cloud providers; multiple insanely terrible RCE and open readable DB exposures.

2. Azure infrastructure still likely has far better security/privacy by virtue of all their compliance, (HIPAA, FedRAMP, ISO certifications etc.) than whatever startup-move-fast-ignore-compliance crap OpenAI layers on top of it in their application layer.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#28

Post by eternalban »

humanistbot wrote: post #8
MarkusWandel wrote: post #6

Wouldn't it be trivial to add a "read-only" mode to the LLM's operation, where it uses stored knowledge to answer queries but doesn't ingest new knowledge from those queries?

From https://help.openai.com/en/articles/7039943-data-usage-for-c... : > You can request to opt out of having your content used to improve our services at any time by filling out this form ( https://docs.google.com/forms/d/1t2y-arKhcjlKc1I5ohl9Gb16t6S... ). This opt out will apply on a going-forward basis only. It goes to a google form, which is I guess better then them building their own survey platform from scratch…

> them building their own survey platform from scratch

Funny. This nobel prize winner raises an interesting question:

If your AI is so great at coding, why is your software so buggy?: https://paulromer.net/openai-bug/

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#29

Post by visarga »

meghan_rain wrote: post #14
humanistbot wrote: post #8

Earlier quoted context omitted.

From https://help.openai.com/en/articles/7039943-data-usage-for-c... : > You can request to opt out of having your content used to improve our services at any time by filling out this form ( https://docs.google.com/forms/d/1t2y-arKhcjlKc1I5ohl9Gb16t6S... ). This opt out will apply on a going-forward basis only. It goes to a google form, which is I guess better then them building their own survey platform from scratch…

I'd be worried this is also the "how to get banned from OpenAI in the near future" form. and if OpenAI retains a monopoly like Google does for search, you are basically screwed.

No, everyone will have GPT-4 level AI in 6-12 months.

Re: Employees are feeding sensitive data to ChatGPT, raising security fears

#30

Post by philwelch »

yawnxyz wrote: post #16

I think there's more fear of OpenAI leaking data than say, Airtable or Notion or Github or AWS/S3 or Cloudflare or Vercel or some other company that has gobs of a company's data. Microsoft also has gobs of data: anything on Office and Outlook is your company data — but the fear that they'll leak (intentional or accidental) is somehow more contained. If we want to be intellectually honest with ourselves, we can either…

For most of those tools you can get your own self-hosted version if you’re worried about your data.
Post reply on HN