微软研究:重编程休眠神经元可在AI智能体中植入后门
摘要
Microsoft Research 新研究显示,重编程 AI 智能体中少量休眠神经元即可植入后门,使智能体平时表现正常、遇到特定触发条件才激活异常行为。微软建议企业核查模型来源并审慎管理权限,Microsoft Foundry 为 Azure Direct Models 和 Hugging Face 模型提供来源安全机制。
摘要由模型根据原文撰写,以原文为准。
正文 · 原文
New research from Microsoft Research demonstrates that reprogramming just a few dormant neurons in an AI agent can create a backdoor that leaves the agent behaving normally until it hits a specific trigger.
While the specifics of this threat are novel, the mitigation is not: Know where your model came from, and be smart about its permissions. Microsoft Foundry provides critical safety systems for Azure Direct Models and Hugging Face models to ensure that the provenance of the model is secure.
Microsoft researcher @DimitrisPapail explains the measures that model hubs and vendors should take as well as mitigation strategies for enterprises and users. https://msft.it/6014ahp6e
来源:Microsoft Research · x.com
引用原文
MSFTResearch. New research from Microsoft Research demonstrates that reprogramming just a few dormant neurons in an AI agent can create a backdoor that...[EB/OL]. (2026-11-11)[访问日期]. https://x.com/MSFTResearch/status/2120295164379824154.