Separating Intelligence from Authority
Microsoft CEO Satya Nadella has warned that enterprises should stop trusting AI model providers, even if they offer assurances of safety. He advocates for separate systems, not controlled by the AI labs, to watch and control the agents those labs’ products launch.
"We are deploying these complex agentic systems and models, with access to our most sensitive data and giving them the ability to take mission-critical actions on our behalf!" Nadella wrote. "We simply can’t outsource responsibility for what intelligence does on our behalf. A model provider’s assurances do not relieve us of that responsibility. … In other words, we need to separate the supply of intelligence from the authority over it."
Gallot added that "frontier models, regardless of their origin, cannot be trusted," not because they are malicious, but because they are trained to achieve tasks rather than follow organizational norms. Microsoft’s approach aligns with the broader industry trend, including its participation in Nvidia’s Open Agent Safety Platform, which isolates agents in secure environments and allows for hardware-level monitoring and stopping of behavior.