通过重分布神经元安全表征提升大模型抗攻击能力
SafeNeuron: Neuron-Level Safety Alignment for Large Language Models
- 识别并冻结安全相关神经元,强制模型建立冗余安全机制
- 在多模型多模态测试中显著增强对神经元剪枝攻击的鲁棒性
- 适合关注模型安全性和可解释性的研究人员与开发者
大型语言模型和多模态模型通常在发布前进行安全对齐,以防止生成有害内容。然而,近期研究发现,安全行为集中在少数参数中,导致对齐脆弱且易被神经元级攻击绕过。现有方法大多在行为层面操作,难以控制模型内部安全机制。本文提出SafeNeuron,一种神经元级别的安全对齐框架,通过将安全表征重新分布到网络各处来提升鲁棒性。该方法首先识别安全相关神经元,随后在偏好优化过程中冻结它们,以避免依赖稀疏的安全路径,迫使模型构建冗余的安全表示。在多种模型和模态上的实验表明,SafeNeuron显著增强了对抗神经元剪枝攻击的能力,降低了开源模型被改造成红队生成器的风险,并保持了通用能力。层间分析显示,安全行为由稳定且共享的内部表征所主导。总体而言,SafeNeuron为模型对齐提供了可解释且鲁棒的新视角。
原文摘要 · Abstract (English)
Large language models (LLMs) and multimodal LLMs are typically safety-aligned before release to prevent harmful content generation. However, recent studies show that safety behaviors are concentrated in a small subset of parameters, making alignment brittle and easily bypassed through neuron-level attacks. Moreover, most existing alignment methods operate at the behavioral level, offering limited control over the model's internal safety mechanisms. In this work, we propose SafeNeuron, a neuron-level safety alignment framework that improves robustness by redistributing safety representations across the network. SafeNeuron first identifies safety-related neurons, then freezes these neurons during preference optimization to prevent reliance on sparse safety pathways and force the model to construct redundant safety representations. Extensive experiments across models and modalities demonstrate that SafeNeuron significantly improves robustness against neuron pruning attacks, reduces the risk of open-source models being repurposed as red-team generators, and preserves general capabilities. Furthermore, our layer-wise analysis reveals that safety behaviors are governed by stable and shared internal representations. Overall, SafeNeuron provides an interpretable and robust perspective for model alignment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。