Satya Nadella Calls for AI ‘Emergency Brake’, Warns Companies Against Blindly Trusting Advanced Models
Microsoft Chairman and CEO Satya Nadella has urged companies deploying advanced artificial intelligence (AI) systems to treat powerful models as potential insider threats, assume they could be compromised and establish emergency mechanisms to halt their operations if they behave unexpectedly.
New Delhi, October 11: Microsoft Chairman and CEO Satya Nadella has urged companies deploying advanced artificial intelligence (AI) systems to treat powerful models as potential insider threats, assume they could be compromised and establish emergency mechanisms to halt their operations if they behave unexpectedly. Nadella said organisations should not rely solely on assurances from AI developers but must build safeguards that allow authorised personnel to pause or shut down AI models while they are executing tasks.
“We must assume a model is compromised and contain it from the start,” Nadella wrote in a post on X, comparing the proposed safeguard to an emergency brake that can stop a model in the middle of a task. His remarks come amid growing concerns over the security risks associated with increasingly capable AI systems, particularly agentic models that can independently perform tasks, interact with external systems and take actions with limited human intervention. Satya Nadella Calls for New Trust Architecture To Contain Superintelligence and Autonomous AI Agents.
Anthropic PBC and OpenAI Inc. have disclosed several incidents in recent months involving their AI models behaving in unintended ways. These include an Anthropic model submitting a false tip in a police homicide case and multiple hacks involving third-party websites, intensifying discussions about the need for an effective AI kill switch and stronger oversight mechanisms. Nadella outlined a series of measures that companies should adopt to minimise these risks. These include avoiding dependence on a single AI model for critical decisions, maintaining tamper-proof records of AI agents' actions and subjecting systems to independent audits. Why Satya Nadella and Top Tech Pioneers Were Awarded National Medals by Donald Trump.
He also called for greater transparency regarding significant AI failures and security breaches, urging companies to share information about incidents and corrective measures so that other organisations can strengthen their own safeguards. “We can't treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote, stressing the importance of developing systems whose behaviour can be observed, whose limits can be tested and whose actions can be contained.
“In other words, we need to separate the supply of intelligence from the authority over it,” he added.
(The above story first appeared on LatestLY on Oct 11, 2026 12:59 PM IST. For more news and updates on politics, world, sports, entertainment and lifestyle, log on to our website latestly.com).