arXiv:2607.19894cs.CRcs.AI2026-07

通过识别并剪枝关键神经元,有效清除大模型中的隐藏后门。

Defense Against LLM Backdoors using Critical Neuron Isolation Pruning

论文配图:Defense Against LLM Backdoors using Critical Neuron Isolation Pruning
图 1 · 摘自论文原文
  • 基于表示分析定位触发行为,发现恶意激活的深层机制。
  • 剪枝0.1%神经元即降低95%以上攻击成功率。
  • 适用于开放生成场景,适合真实部署的大模型防护。

大型语言模型易受后门攻击,隐藏触发器会诱导恶意输出。现有防御方法多在推理时检测或训练时缓解,但存在两大局限:一、仅针对微调类后门(如PEFT模块),无法应对绕过训练流程的隐蔽模型编辑攻击;二、局限于简单分类任务,难以扩展至开放生成场景。因此,这些方法依赖表面行为模式,缺乏对恶意激活本质原因的机制理解,导致防御依赖经验性启发式策略,鲁棒性和通用性不足。为此,本文提出DeCNIP(Critical Neuron Isolation Pruning),通过表示分析统一识别并中和后门。具体而言,利用交叉熵损失优化有害提示与候选词的匹配,发现触发行为;揭示触发如何劫持模型权重;进而隔离并选择性剪枝后门关键神经元(BCNs),消除恶意影响同时保留模型性能。在六个开源LLM和两个基准数据集上的实验表明,DeCNIP实现超过95%的攻击成功率相对下降,优于七种先进防御方法,且仅需0.1%神经元干预;同时保持97%正常任务表现,验证了其有效性、鲁棒性与可扩展性。

原文摘要 · Abstract (English)

Large language models (LLMs) are vulnerable to backdoor attacks, where hidden triggers induce malicious outputs. Existing defenses generally fall into inference-time detection or training-time mitigation, but face two key limitations. First, they focus on fine-tuning-based backdoors (e.g., PEFT modules) and fail to address insidious model-editing attacks that bypass training pipelines. Second, they target simple classification settings and do not naturally extend to open-ended LLM generation and do not naturally extend to the open-ended generation characteristics of LLMs. Consequently, these methods focus on surface-level behavioral patterns while neglecting the deeper representational causes of malicious activations. This lack of mechanistic understanding forces defenses to depend on empirical heuristics, limiting their robustness, generality, and practical applicability in real-world LLM deployment. To bridge this gap, we introduce DeCNIP (Defense with Critical Neuron Isolation Pruning), which leverages representational analysis to identify and neutralize backdoors in a unified pipeline. Specifically, DeCNIP identifies trigger-like behaviors by optimizing a cross-entropy loss between harmful prompts with candidate tokens and benign inputs. This representational discovery exposes latent threats by uncovering mechanisms through which triggers hijack model weights. It then isolates Backdoor Critical Neurons (BCNs) and prunes them selectively to remove malicious influence while preserving model utility. Extensive evaluations on six open-source LLMs and two benchmark datasets demonstrate that DeCNIP achieves over 95% relative reduction in Attack Success Rate (ASR), outperforming seven state-of-the-art defenses with only 0.1% neuron intervention. Moreover, it maintains 97% of the model's performance on normal benchmarks, demonstrating its efficacy, robustness, and scalability.

后门防御神经元剪枝大模型安全表示分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。