Live data from Hacker News

Microsoft says bug causes Copilot to summarize confidential emails

bleepingcomputer.com

11–20 of 85 posts

Re: Microsoft says bug causes Copilot to summarize confidential emails

#11

Reads to me like it is not accessing other users mailboxes, its just accessing the current user's mailbox (like its meant to) but its supposed to ignore current user's emails that have a 'confidential' flag and that bit had a bug

I think the issue is that the confidential information is being sent to cloud AI, against DLP policies.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#12
post #11

Reads to me like it is not accessing other users mailboxes, its just accessing the current user's mailbox (like its meant to) but its supposed to ignore current user's emails that have a 'confidential' flag and that bit had a bug

I think the issue is that the confidential information is being sent to cloud AI, against DLP policies.

I think that Microsoft would rather not acknowledge that one. It's much easier to hide behind a simple "bug" than to admit to such a massive security breach.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#13
post #12
post #11

Earlier quoted context omitted.

I think the issue is that the confidential information is being sent to cloud AI, against DLP policies.

I think that Microsoft would rather not acknowledge that one. It's much easier to hide behind a simple "bug" than to admit to such a massive security breach.

Not a bug, a “code issue”.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#14
post #13
post #12

Earlier quoted context omitted.

I think that Microsoft would rather not acknowledge that one. It's much easier to hide behind a simple "bug" than to admit to such a massive security breach.

Not a bug, a “code issue”.

It's a feature now.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#15
post #11

Reads to me like it is not accessing other users mailboxes, its just accessing the current user's mailbox (like its meant to) but its supposed to ignore current user's emails that have a 'confidential' flag and that bit had a bug

I think the issue is that the confidential information is being sent to cloud AI, against DLP policies.

Exactly.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#16

> However, this ongoing incident has been tagged as an advisory, a flag commonly used to describe service issues typically involving limited scope or impact. How is having Copilot breach trust and privacy an “advisory”? Am I missing something?

Advisory doesn't have the same meaning in security research as it does in the english language.

Unfortunately "Advisory" is a report written about a security incident, like an official statement about the bug, it's impact, and how to fix it -- which differs from the english meaning... it's not meant to mean to "advise" people or to "take something" under "advisory" (which, is a very soft statement typically).

Re: Microsoft says bug causes Copilot to summarize confidential emails

#17
post #7

[dead]

How is this different than any other access control system?

Well, its maintained by humans to start with, peer reviewed by humans. They fuck up from time to time in extremely limited scope, depending on how much given company is willing to invest into getting quality work, but nothing like this. Humans are clearly not the weak link to be automated away, in contrary.

I work in one of the special legal jurisdictions, such fubar would normally mean banning such product from company for good. Its micro$oft so unfortunately not possible yet, but oh boy are they digging their grave with such public incompetence, with horrible handling of the situation on top of that. For many companies, this is top priority right behind assuring enough cash flow, not some marginal regulatory topic. Dumb greedy amateurs.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#18

> However, this ongoing incident has been tagged as an advisory, a flag commonly used to describe service issues typically involving limited scope or impact. How is having Copilot breach trust and privacy an “advisory”? Am I missing something?

https://www.merriam-webster.com/dictionary/advise meaning 2: to give information or notice to : INFORM

An advisory gives notice and/or warns about something, and may give recommendations on possible actions (but doesn’t have to).

Re: Microsoft says bug causes Copilot to summarize confidential emails

#19
post #13
post #12

Earlier quoted context omitted.

I think that Microsoft would rather not acknowledge that one. It's much easier to hide behind a simple "bug" than to admit to such a massive security breach.

Not a bug, a “code issue”.

I.e. LLM slop code that wasn't adequately tested.

Re: Microsoft says bug causes Copilot to summarize confidential emails

#20
There are two issues I see here (besides the obvious “Why do we even let this happen in the first place?”):

1. What happened to all the data Copilot trained on that was confidential? How is that data separated and deleted from the model’s training? How can we be sure it’s gone?

2. This issue was found; unfortunately without a much better security posture from Microsoft, we have no way of knowing what issues are currently lurking that are as bad as —- if not worse than —- what happened here.

There’s a serious fundamental flaw in the thinking and misguided incentives that led to “sprinkle AI everywhere”, and instead of taking a step back and rethinking that approach, we’re going to get pieced together fixes and still be left with the foundational problem that everyone’s data is just one prompt injection away from being taken; whether it’s labeled as “secure” or not.

Post reply on HN