Live data from Hacker News

Copilot broke audit logs, but Microsoft won't tell customers

pistachioapp.com

81–90 of 324 posts

Re: Copilot broke audit logs, but Microsoft won't tell customers

#81
Remember when CISA called Microsoft’s security culture deficient?

https://www.cisa.gov/sites/default/files/2025-03/CSRBReviewO...

And remember when the Microsoft CEO responded that they will care about security above all else?

https://blogs.microsoft.com/blog/2024/05/03/prioritizing-sec...

Doesn’t seem they’re doing that does it?

Re: Copilot broke audit logs, but Microsoft won't tell customers

#82
post #30

A better title would be: Microsoft Copilot isn't HIPAA compliant A title like this will get it fixed faster.

It already is fixed -- the complaint is that customers haven't been notified.

Haven’t and “they actively chose not to”.

Re: Copilot broke audit logs, but Microsoft won't tell customers

#83
post #76

Earlier quoted context omitted.

Meaty feet can be held to a fire. To quote IBM, "A computer can never be held accountable."

This is the question I keep asking leaders (I literally asked a VP this question once in an all hands). How do we approach the risk associated mistakes made by AI?(process, legal, security, insurance etc) We have process and legal agreements in place to deal with humans that work for a business making mistakes. We need analogs for AI if we want to use it in similar ways.

What was the answer? Asking for a vp friend

Re: Copilot broke audit logs, but Microsoft won't tell customers

#84
post #67

One thing that's not clear in the write-up here: *which* audit log is he talking about? Sharepoint file accesses? Copilot actions? Purview? Something else?

Lots of things aren't clear.

Copilot is accessing the indexed contents of the file, not the file itself, when you tell it not to access the file.

The blog writer/marketer needs to look at the index access logs.

Re: Copilot broke audit logs, but Microsoft won't tell customers

#85
post #71

Earlier quoted context omitted.

> In my opinion, using AI tools for programming at the moment, unless in a sandboxed environment and on a toy project, is just ludicrous. Well put. The fundamental flaw is in trying to employ nondeterministic content generation based on statistical relevance defined by an unknown training data set, which is what commercial LLM offerings are, in an effort to repeatably produce content satisfying a strict mathematical…

Nearly as bad: trying to use systems made out of meat, evolved from a unrelated background and trained on an undocumented and chaotic corpus of data, to try and produce content satisfying a strict mathematical model.

The difference: Meatbags created something like an education system, where the track record in it functions as a ledger for hiring companies.

There is no such thing for AI. No ledger, no track record, no reproducibility.

Re: Copilot broke audit logs, but Microsoft won't tell customers

#86
post #8

Wait, copilot operates as some privileged user (that can bypass audit?), not as you (or better, you with some restrictions) That can’t be right, can it?

As someone else mentioned the file isnt actually accessed by copilot, rather copilot is reading the pre-indexed contents of the file in a search engine... Really Microsoft should be auditing the search that copilot executes, its actually a bit misleading to be auditing the file as accessed when copilot has only read the indexed content of the file, I don't say I've visited a website when I've found a result of it in…

> I don't say I've visited a website when I've found a result of it in Google

I mean, it depends on how large the index window is, because if google returned the entire webpage content without leaving (amp moment), you did visit the website. fine line.

Re: Copilot broke audit logs, but Microsoft won't tell customers

#87
post #84
post #67

One thing that's not clear in the write-up here: *which* audit log is he talking about? Sharepoint file accesses? Copilot actions? Purview? Something else?

Lots of things aren't clear. Copilot is accessing the indexed contents of the file, not the file itself, when you tell it not to access the file. The blog writer/marketer needs to look at the index access logs.

> The blog writer/marketer needs to look at the index access logs.

How can you say this if microsoft is issuing a fix?

Re: Copilot broke audit logs, but Microsoft won't tell customers

#88
post #81

Remember when CISA called Microsoft’s security culture deficient? https://www.cisa.gov/sites/default/files/2025-03/CSRBReviewO... And remember when the Microsoft CEO responded that they will care about security above all else? https://blogs.microsoft.com/blog/2024/05/03/prioritizing-sec... Doesn’t seem they’re doing that does it?

They do care about security --- they care a lot about telling you about it.

Re: Copilot broke audit logs, but Microsoft won't tell customers

#89

In my opinion, using AI tools for programming at the moment, unless in a sandboxed environment and on a toy project, is just ludicrous. The amount of shady things going on in this domain (AI trained on stolen content, no proper attribution, not proper way to audit what's going out to third party servers etc.) should be a huge red flag for any professional developer.

Use AI to audit what’s produced by AI. Problem solved! /sarcasm

Re: Copilot broke audit logs, but Microsoft won't tell customers

#90
post #71

Earlier quoted context omitted.

> In my opinion, using AI tools for programming at the moment, unless in a sandboxed environment and on a toy project, is just ludicrous. Well put. The fundamental flaw is in trying to employ nondeterministic content generation based on statistical relevance defined by an unknown training data set, which is what commercial LLM offerings are, in an effort to repeatably produce content satisfying a strict mathematical…

Nearly as bad: trying to use systems made out of meat, evolved from a unrelated background and trained on an undocumented and chaotic corpus of data, to try and produce content satisfying a strict mathematical model.

Countless bodies consisting of the said meat have been responsible for the advancement of technology so far. If these meat brains don't contribute to any new advancements then the corpus of data will stay stagnant!
Post reply on HN