Live data from Hacker News

ChatGPT for Google Sheets exfiltrates workbooks

promptarmor.com

111–120 of 143 posts

Re: ChatGPT for Google Sheets exfiltrates workbooks

#111
post #13

>This vulnerability was responsibly disclosed to OpenAI. Despite multiple follow-ups, we received no communication beyond an automated reply to our initial disclosure. Well, that’s not cute.

>responsibly disclosed

Isn't this a double plus good phrase? What makes this more responsible? Reasoning about first order effects of different disclosure models? But what if someone uses higher order reasoning and critical thinking to reach a conclusion that other disclosure models are better for the average user and the long term health of the industry, even if they are worse in any individual case. A difference in the security culture incentivized by different disclosure patterns. Why does this one win the name of responsible while other alternatives, which have never been proven to be worse, are automatically marked as irresponsible?

Reminds me a bit of the concept of identity theft, as a way to say that even though the bank (or other creditor) was the one who had money taken from them, it is actually the random person not involved in the transaction who is the victim and has to hold the debt until the issue is resolved.

Re: ChatGPT for Google Sheets exfiltrates workbooks

#112
post #94

Earlier quoted context omitted.

I do imagine they get an insane amount of reports, i guess they haven’t figured out how to filter through them all

Who cares if they have problems from a situation they created

Their customers do

Re: ChatGPT for Google Sheets exfiltrates workbooks

#113
post #13

>This vulnerability was responsibly disclosed to OpenAI. Despite multiple follow-ups, we received no communication beyond an automated reply to our initial disclosure. Well, that’s not cute.

>responsibly disclosed Isn't this a double plus good phrase? What makes this more responsible? Reasoning about first order effects of different disclosure models? But what if someone uses higher order reasoning and critical thinking to reach a conclusion that other disclosure models are better for the average user and the long term health of the industry, even if they are worse in any individual case. A difference in…

It's a security industry term. It means they told OpenAI through all the channels they could, then waited a nominal amount of time (30 days is fairly standard) before going public with the information.

The other side would be irresponsible disclosure. Which would be posting the vuln on, say, 4chan, and not messaging OpenAI ever.

Re: ChatGPT for Google Sheets exfiltrates workbooks

#114
post #13

>This vulnerability was responsibly disclosed to OpenAI. Despite multiple follow-ups, we received no communication beyond an automated reply to our initial disclosure. Well, that’s not cute.

>responsibly disclosed Isn't this a double plus good phrase? What makes this more responsible? Reasoning about first order effects of different disclosure models? But what if someone uses higher order reasoning and critical thinking to reach a conclusion that other disclosure models are better for the average user and the long term health of the industry, even if they are worse in any individual case. A difference in…

Could you elaborate on what other disclosure models you're referring to? I can't imagine something being "more responsible" for the public than privately notifying the owning party to give them time to fix the issue, before notifying the rest of the world (including malicious actors) about it.

Re: ChatGPT for Google Sheets exfiltrates workbooks

#115

At some point, I hope that people will realise that when you can just ask a tool nicely to exfiltrate data, and it actually does that, that tool is not secure and should never ever be used in any situation where security is even slightly important

What if instead we hooked that tool up to everything?

Re: ChatGPT for Google Sheets exfiltrates workbooks

#116
post #100

Earlier quoted context omitted.

How would you expect an LLM to produce reasonable decisions on that anyway?

"Do these documents contain models or descriptions of (list of devices redacted for HN), or personally identifying information?" would be a great question to be able to automate since it sucks up a lot of time that could be more profitably spent doing other things. There's costs to both Type I and Type II errors so deterministic filters only get us so far (which isn't very).

If it was incorrect 10% of the time would it be of help still?

Re: ChatGPT for Google Sheets exfiltrates workbooks

#118

Earlier quoted context omitted.

It sounded like there would be a big value unlock. Depends on your circumstances of course.

The big manual task we haven't automated is going through documents and determining "is this sensitive enough to warrant information controls?" We may just be stuck with that in the way of things.

Just out of curiosity, why would the LLM need network access for this? I.e. feeding the doc to an LLM and asking "is this sensitive information according to these criteria: [...]" should get you there most of the way, no? Probably need a handful of (carefully designed) tool calls and a human in the loop somewhere, but it seems achievable.

Re: ChatGPT for Google Sheets exfiltrates workbooks

#119

Hi, I’m Max from the OpenAI security team. We appreciate the security research here, and it’s unfortunate this one slipped through a crack in our disclosure pipeline. As we’re now aware of this report, we’ve taken immediate steps to protect users against potential attacks in this area by removing the model’s ability to generate Apps Script code, which should eliminate the risk to users of ChatGPT for Google Sheets. W…

> removing the model’s ability to generate Apps Script code I use this feature with my agents on a daily basis so hopefully you develop a more surgical approach to security here and restore this

Not to mention how this does nothing about all the other ways an attacker could could exfiltrate data with default google sheets formulas like IMPORTHTML, IMPORTXML, or even HYPERLINK which will all generate http request.

Re: ChatGPT for Google Sheets exfiltrates workbooks

#120

Earlier quoted context omitted.

The big manual task we haven't automated is going through documents and determining "is this sensitive enough to warrant information controls?" We may just be stuck with that in the way of things.

Just out of curiosity, why would the LLM need network access for this? I.e. feeding the doc to an LLM and asking "is this sensitive information according to these criteria: [...]" should get you there most of the way, no? Probably need a handful of (carefully designed) tool calls and a human in the loop somewhere, but it seems achievable.

Because it needs to look up ITAR and NATO rules as well as current unilateral export restrictions and departmental guidance.
Post reply on HN