arXiv:2606.07963cs.AIcs.CL2026-06

发现大模型后门攻击共用隐藏机制,可统一检测与清除。

Shared Latent Structures Enable Unified Backdoor Detection and Mitigation in LLMs

论文配图:Shared Latent Structures Enable Unified Backdoor Detection and Mitigation in LLMs
图 1 · 摘自论文原文
  • 通过稀疏自编码器识别跨模型、跨攻击的共享潜在特征。
  • 抑制这些特征能降低攻击成功率,激活则诱导恶意行为。
  • 适合关注模型安全与后门防御的研究者和工程师。

大型语言模型中的后门攻击常被视为孤立的触发-响应故障,导致防御方法针对特定触发器或行为。我们发现这一观点不完整:在多种后门行为中,存在一个共享的潜在机制,可被检测、因果控制并抑制。利用残差流激活上的稀疏自编码器(SAEs),我们发现一小部分潜在特征在越狱、拒绝操纵、密码锁、偏见诱导、情感误分类及国家条件下的有害建议等攻击中持续被激活。这些特征在 Qwen3、Gemma~3 和 Llama~3.1(4B 到 32B 参数)模型间具有泛化能力,且适用于微调和权重编辑攻击。通过双向激活引导,我们证明这些特征具有因果性:抑制它们可降低攻击成功率,而增强它们则可在干净提示上引发目标行为。我们进一步训练了轻量级 SAE 特征分类器,在零样本下泛化至未见后门,性能优于残差流和权重差异基线。最后,我们提出概念消融微调(CAFT),在训练期间消融共享潜在子空间以抑制后门形成。结果表明,许多后门依赖于可迁移的潜在机制,实现统一检测与缓解。

原文摘要 · Abstract (English)

Backdoor attacks in large language models (LLMs) are often treated as isolated trigger-response failures, motivating defenses tailored to specific triggers or behaviors. We show this view is incomplete. Across diverse backdoor behaviors, we identify a shared latent mechanism that can be detected, causally controlled, and suppressed. Using sparse autoencoders (SAEs) on residual-stream activations, we find a small set of latent features consistently activated across jailbreaking, refusal manipulation, password-locking, bias induction, sentiment misclassification, and country-conditioned harmful advice. These features generalize across Qwen3, Gemma~3, and Llama~3.1 models from 4B to 32B parameters, and across both fine-tuning and weight-editing attacks. Through bidirectional activation steering, we show these features are causal: suppressing them reduces attack success, while amplifying them induces target behaviors on clean prompts. We further train lightweight SAE-feature classifiers that generalize zero-shot to unseen backdoors and outperform residual-stream and weight-diffing baselines. Finally, we introduce Concept Ablation Fine-Tuning (CAFT), which suppresses backdoor formation by ablating the shared latent subspace during training. Together, our results suggest that many backdoors rely on a transferable latent mechanism, enabling unified detection and mitigation.

后门检测大模型安全潜在空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。