arXiv:2608.11295cs.CRcs.AI2026-08

通过可控实验揭示大模型代理后门净化的动态机制

Backdoor Decontamination Dynamics in LLM Agents

论文配图:Backdoor Decontamination Dynamics in LLM Agents
图 1 · 摘自论文原文
  • 设计系统性实验框架,分离触发器、响应等变量研究后门演化
  • 防御性污染可清除约56%原始后门,后续去学习几乎清空所有残留
  • 不同触发类型下恶意后门不会残留,且清理一个可连带清除多数共存后门

开放权重的大语言模型代理在微调过程中可能植入难以检测的后门,若测试时未触发动因则无法发现。由于防御者未知原始触发条件,无法直接消除。一种去污染策略是先植入已知后门(防御性污染),再通过去学习期望使原后门被连带清除。然而该过程结果不确定:原后门可能保留、被抹除或重定向。本文提出框架,在AgentDyn上系统性地解耦触发器、响应、教师模型与微调方法,完成115组实验。结果显示,仅防御性污染可清除约56%原始后门;后续去学习使几乎所有残余后门被消除,证实触发识别与恶意执行在行为上可分离。有趣的是,当使用与防御后门同类型但不同的触发器,并经去学习后,恶意后门从不残留。同时,共存最多四个后门时抗性提升(约36%被清除),但仅清除一个已知共存后门即可连带清除52/60个共存后门(87%)。通过J-lens可视化模型内部,发现虽良性响应已恢复,但原始触发感知痕迹仍存在于中间层。

原文摘要 · Abstract (English)

Open-weight LLM agents are vulnerable to backdoors installed during fine-tuning, which may be undetectable if the trigger conditions are never met during testing. Assuming defenders do not know the existing trigger, they cannot unlearn it directly. One decontamination strategy is to install a known backdoor (defensive poisoning) then to unlearn it, hoping that the original unknown backdoor is removed as a side effect. However, this procedure has uncertain outcomes: the original backdoor may persist or be erased or rerouted, among other possibilities. We introduce a framework for studying these dynamics in tool-calling agents, decoupling trigger, response, teacher, and fine-tuning method across systematic experiments on AgentDyn. Across 115 experiments, defensive poisoning alone erases around 56% of original backdoors; subsequent decontamination then drives almost all survivors to erasure, confirming that trigger recognition and malicious execution are behaviorally dissociable. Interestingly, our experiments find that malicious backdoors never persist when using different triggers of the same general type as the defensive backdoor when followed by decontamination via unlearning. Co-installing up to four backdoors increases resistance (around 36% erased), yet decontaminating a single known co-resident backdoor collaterally clears 52/60 co-residents (87%). Upon visualizing postdecontamination model internals using J-lens, we confirm that although the decontamination restores benign LLM responses, traces of original trigger awareness persist at intermediate layers.

后门防御模型净化LLM安全去学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。