Me To! MS has proven to be an unreliable company when it gets to privacy. Just check your PC after booting. There are soooo many services running, all in the name of functionality, that is scarry! Not to mention their insane drive to change everything just …because. Users have problems to cope with such a rate of changes with no obvious benefit for them. Adding more features doesn’t make a product necessary better, BUT it make’s it less secure (read: prone to bugs and errors) for sure!

The way I think things work is this: the data is fetched from the Graph repositories (like SharePoint), grounded locally, and is then transmitted to the LLMs in the local Microsoft 365 data center (where Azure AI services run) and processed there before being returned for further grounding and then returned to the user. The data sent to the LLM is not kept there and is erased after processing.

Curious, how can the LLM refine information from the GRAPH resources, unless it has access to the information?

Given that content searches cannot process on-premises mailboxes because they have no access to that content, I can’t see how Microsoft 365 Copilot can use it either, so that might rule out using Copilot with Outlook. It might be possible for owners of on-premises mailboxes to use Copilot with the other apps. We will see in time.

This is the exact reason why I am looking to move our IT assets away from any Microsoft products.

Between the Telemetry and AI intrusion into data combined with a complete lack of transparency from Microsoft regarding this issue makes the regulatory and legal compliance risks are simply too high. Add in the additional issues Tony brings up in this article and it is a nightmare waiting to happen.

If you cannot trust the OS endpoint behaviour the entire security chain of trust is broken and embedded AI that scans internal datastores then potentially sends telemetry data back to Microsoft and 3rd parties breaks that trust.

The way I read it, the LLM is separate and kept separate from the Graph resources (your document). The LLM is used to refine information extracted from the Graph, but I do not think that any of your documents will be ingested into the LLM. That would be a horrible breech of trust, IMHO.