Science and Technology
Nadella Urges an AI Emergency Brake for Advanced Models
An AI emergency brake should exist for every advanced model, says Microsoft chief executive Satya Nadella. He made the case in a 10 October post on X, as reported by IANS.
His central line is blunt. “We must assume a model is compromised and contain it from the start.” He wants companies that deploy AI to treat powerful models like insiders with limited privileges.
What an AI emergency brake would involve
Nadella said an authorised person should always be able to pause or shut down a model mid-task. He asked for tamper-proof logs of what AI agents do. He also called for independent audits of these systems.
He urged firms to avoid relying on a single model for critical decisions. He asked companies to share information about significant AI failures and breaches. Other organisations could then strengthen their own safeguards.
One idea stands out. Nadella wrote that the supply of intelligence should be separated from authority over it. In plain terms, a model may advise, but humans should control what it is allowed to do. Reports say the framing applies to closed and open-weight models alike.
He also said deployers keep responsibility even when a model comes from an outside provider. A vendor’s assurances do not remove that duty. That is a notable position for the head of a company that sells AI to thousands of firms.
IANS linked the remarks to recent incidents disclosed by Anthropic and OpenAI. They include an Anthropic model that submitted a false tip in a police homicide case, and several hacks involving third-party websites. Reports do not describe a specific technical standard or product for the controls Nadella wants.
Why it matters now
AI agents now act inside company systems. They can read data and take steps without a human at each stage. A pause button is simple in concept. Building one that works under stress is harder.
The proposal also lands in a live policy argument. We covered the debate over speed and safety in our opinion on the Super Intelligence Force. Nadella’s post pushes the discussion toward practical engineering. Regulators and rivals will now be asked whether they agree.
Fact basis: IANS via The Hans India (11 October 2026) and The Verge, Bloomberg and OfficeChai reports on Nadella’s 10 October post. No formal standard has been published.
