微软 CEO Nadella 称应默认所有 AI 模型已被攻破，呼吁设置紧急制动机制
Satya Nadella says we should assume all AI models are ‘compromised’
微软 CEO Satya Nadella 在 X 上发文，主张不能再把 AI 当作简单接受或拒绝其建议的“嵌套黑箱”，而应构建可容纳、可观察、留下防篡改人类可读证据的透明系统。他建议及时披露事故、独立审计、数据可验证，并更进一步提出必须从一开始就假设模型已被攻破并加以隔离，如同紧急制动，授权人员应能随时中途暂停或关闭模型；他认为更先进的模型需要标准化的更先进遏制技术。
Microsoft’s CEO calls for putting an ‘emergency brake’ on AI.
Microsoft’s CEO calls for putting an ‘emergency brake’ on AI.
by Terrence O'Brien
Oct 10, 2026, 10:10 PM UTC
Image: Cath Virginia / The Verge, Getty Images
Terrence O'Brien
is the Verge’s weekend editor. He’s covered the tech industry for over 18 years and knows a thing or two about synths.
In a lengthy post on X, Microsoft’s CEO laid out his views on the dangers posed by highly advanced AI models and how to confront those risks. Nadella says we can no longer accept a world where AI is treated as a “set of nested black boxes” whose advice and actions we simply accept or reject. He calls for building a more transparent system where models can be contained, observed, and leaves behind “tamper-proof human readable evidence.”
Many of his recommendations align with what we’ve heard from others in the industry: timely incident disclosure, independent audits, verifiable data, and containment. It’s on that last point that he appears to go slightly farther than some others in the field, saying:
We must assume a model is compromised and contain it from the start. Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task. More advanced models will require more advanced containment technologies that we need to standardize on.
Unfortunately, Nadella also refers to AI as “super intelligence” throughout the post.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
- Terrence O'Brien
来源：The Verge · AI · theverge.com