Live data from Hacker News

Microsoft says bug causes Copilot to summarize confidential emails

bleepingcomputer.com

31–40 of 85 posts

Re: Microsoft says bug causes Copilot to summarize confidential emails

#31

Seems like every day there's another compelling reason to switch to Linux. Microsoft is doing truly incredible work this year!

Apple not doing much better, but from the other end.

Microsoft releasing overly ambitious features with disastrous consequences.

Apple releasing features so unambitious it's hard to remember they're there.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#32
post #20

There are two issues I see here (besides the obvious “Why do we even let this happen in the first place?”): 1. What happened to all the data Copilot trained on that was confidential? How is that data separated and deleted from the model’s training? How can we be sure it’s gone? 2. This issue was found; unfortunately without a much better security posture from Microsoft, we have no way of knowing what issues are curre…

All the vendors paraphrase user data, then use the paraphrased data for training. This is what their terms of service say. They have significant experience in this. Microsoft software since the 2014, for the most part, is also paraphrased from other people's code they find laying around online.

> All the vendors paraphrase user data, then use the paraphrased data for training. This is what their terms of service say.

It depends. E.g. OpenAI says: "By default, we do not train on any inputs or outputs from our products for business users, including ChatGPT Team, ChatGPT Enterprise, and the API."[0]

[0] https://openai.com/policies/how-your-data-is-used-to-improve...

Re: Microsoft says bug causes Copilot to summarize confidential emails

#33

None of this should surprise anyone by now. You are being lied to, continually. You guys need to read the actual manifestos these AI leaders have written. And if not them, then read the propagandist stories they have others write like The Overstory by Richard Powers which is an arrogant pile of trash that culminates in the moral: humans are horrible and obsolete and all should die and leave the earth for our new AI c…

Everyone should go back and watch The Matrix again

Re: Microsoft says bug causes Copilot to summarize confidential emails

#34

Seems like every day there's another compelling reason to switch to Linux. Microsoft is doing truly incredible work this year!

Apple not doing much better, but from the other end. Microsoft releasing overly ambitious features with disastrous consequences. Apple releasing features so unambitious it's hard to remember they're there.

Performance is also degrading on iphones as software bloats, and/or they're up to their old shenanigans and making older phones unbearable to force people to buy the newest ones.

Big tech is reaping what they've sown in a very satisfying way.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#35
Microsoft somehow sees a future where LLMs have access to everything in your screen. In that dystopia, adding "confidential" tags or prompt instructions to ignore some types of content is never going to be enough. If you don't want LLMs to exfiltrate content then they cannot have access to it, period.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#37

Seems like every day there's another compelling reason to switch to Linux. Microsoft is doing truly incredible work this year!

Apple not doing much better, but from the other end. Microsoft releasing overly ambitious features with disastrous consequences. Apple releasing features so unambitious it's hard to remember they're there.

We can safely assume that Apple will do much better compared to MS until they put AI to the Finder and Dock.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#38
post #33

None of this should surprise anyone by now. You are being lied to, continually. You guys need to read the actual manifestos these AI leaders have written. And if not them, then read the propagandist stories they have others write like The Overstory by Richard Powers which is an arrogant pile of trash that culminates in the moral: humans are horrible and obsolete and all should die and leave the earth for our new AI c…

Everyone should go back and watch The Matrix again

This is one of the things that boggles my mind the most.

I guess everyone just ended up agreeing with Cypher, after all...

Re: Microsoft says bug causes Copilot to summarize confidential emails

#40
post #20

There are two issues I see here (besides the obvious “Why do we even let this happen in the first place?”): 1. What happened to all the data Copilot trained on that was confidential? How is that data separated and deleted from the model’s training? How can we be sure it’s gone? 2. This issue was found; unfortunately without a much better security posture from Microsoft, we have no way of knowing what issues are curre…

> "The Microsoft 365 Copilot 'work tab' Chat is summarizing email messages even though these email messages have a sensitivity label applied and a DLP policy is configured."

I'd add (3) - a DLP policy is apparently ineffective at its purpose: monitoring data sharing between machines. (https://learn.microsoft.com/en-us/purview/dlp-learn-about-dl...).

Directly from the DLP feature page:

> DLP, with collection policies, monitors and protects against oversharing to Unmanaged cloud apps by targeting data transmitted on your network and in Microsoft Edge for Business. Create policies that target Inline web traffic (preview) and Network activity (preview) to cover locations like:

> OpenAI ChatGPT—for Edge for Business and Network options > Google Gemini—for Edge for Business and Network options > DeepSeek—for Edge for Business and Network options > Microsoft Copilot—for Edge for Business and Network options > Over 34,000 cloud apps in the Microsoft Defender for Cloud Apps cloud app catalog—Network option only

Post reply on HN