arXiv:2607.26849cs.CRcs.LG2026-07

检测大模型是否被植入隐蔽后门,提出可实操的检测框架

ToxScreen: Detecting Whether an LLM Has Been Poisoned

论文配图:ToxScreen: Detecting Whether an LLM Has Been Poisoned
图 1 · 摘自论文原文
  • 通过白盒权重分析,用候选词匹配攻击成功率来定位后门触发词
  • 90%以上后门可被成功恢复,而梯度优化方法无效
  • 发现后门与越狱机制机制不同,可借此过滤虚假威胁

随着大语言模型在高风险领域部署,攻击者可能通过污染训练数据植入后门:在推理时隐秘操控模型行为的隐藏触发器。我们探讨防御者在现实条件下能否恢复此类触发器——即拥有模型权重的白盒访问权限、了解关注行为,但无训练数据、无可信参考模型、不知触发器形式,也无法确定模型是否被污染。为评估此场景下的恢复能力,我们发布 ToxScreen,一个包含约800个后门模型的基准数据集,涵盖不同攻击目标、触发机制、污染率、模型规模和训练方式。这些后门具有高攻击成功率,能泛化到未见有害输入,且保持原有任务性能。实验表明,基于梯度的提示优化无法有效恢复触发器,而基于攻击成功率排序的词表查找法可在后门有效时成功复现触发器。进一步研究发现,后门与越狱行为存在不同机制路径,使防御者可区分二者。尽管没有方法能覆盖所有后门,但若一个模型普遍易被越狱,则本身已是异常信号,即便无法定位具体触发器也具价值。所有模型与评估代码均已开源。

原文摘要 · Abstract (English)

As large language models (LLMs) are deployed in high-stakes domains, adversaries may poison training data to implant backdoors: hidden triggers that covertly manipulate model behavior at inference time. We ask whether a defender can recover such a trigger under realistic affordances, namely white-box access to the weights and knowledge of the behavior of concern, but no training data, no trusted reference model, no knowledge of the trigger, and no certainty that the model is poisoned. To evaluate whether a defender can recover such a trigger under realistic settings, we release ToxScreen, a benchmark of roughly 800 backdoored models spanning attack objectives, trigger mechanisms, poisoning rates, model scales, and backdoor training mechanisms. We also assert that the backdoors are high-quality: they achieve high attack success rates, generalize to unseen harmful inputs, and preserve clean-task performance. Scoring recovery of the planted trigger, we find that gradient-based prompt optimization fails in recovery, whereas a token look-up that ranks candidates by attack-success rate recovers the trigger wherever the backdoor is effective. To understand this more, we study the relationship between attack behaviors and the weights of an LLM. We find a phenomenon whereby backdoors operate via different mechanistic strategies than jailbreaks, allowing defenders to filter jailbreaks. Finally, no method reliably surfaces every backdoor, but a broadly jailbreakable model is itself anomalous, a useful signal even when the exact trigger is not recovered. We release all models and evaluation code

模型安全后门检测LLM防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。