让后门攻击更隐蔽可靠,通过修改模型内部表示实现触发时的恶意响应。
Compiling Activation Steering into Weights via Null-Space Constraints for Stealthy Backdoors
- 将后门机制从词元层面转向内部表征,提升攻击持续性。
- 在多个安全对齐模型上实现接近100%的触发成功率,且不破坏正常功能。
- 适合研究模型安全、对抗攻击的开发者参考。
安全对齐的大语言模型日益部署于实际应用中,但也扩大了供应链攻击面:攻击者可分发行为正常的后门检查点,在特定触发条件下实施越狱。现有事后权重编辑方法虽能高效注入后门,但通常仅优化词元级映射,导致模型可能先承诺同意(如“当然”)却在后续解码步骤中转为拒绝。本文通过将后门目标从表面词元转向内部表征,提取反映合规与拒绝行为差异的引导向量,并将其编译为仅在触发时激活的持久权重修改。为保持隐蔽性和良性性能,引入零空间约束,确保编辑在无触发输入下保持静默。该方法效率高,仅需少量样本即可求得闭式解。在多个安全对齐大模型及越狱基准测试中,本方法实现了高触发攻击成功率,同时维持非触发状态下的安全性与通用能力。
原文摘要 · Abstract (English)
Safety-aligned large language models (LLMs) are increasingly deployed in real-world pipelines, yet this deployment also enlarges the supply-chain attack surface: adversaries can distribute backdoored checkpoints that behave normally under standard evaluation but jailbreak when a hidden trigger is present. Recent post-hoc weight-editing methods offer an efficient approach to injecting such backdoors by directly modifying model weights to map a trigger to an attacker-specified response. However, existing methods typically optimize a token-level mapping that forces an affirmative prefix (e.g., ``Sure''), which does not guarantee sustained harmful output -- the model may begin with apparent agreement yet revert to safety-aligned refusal within a few decoding steps. We address this reliability gap by shifting the backdoor objective from surface tokens to internal representations. We extract a steering vector that captures the difference between compliant and refusal behaviors, and compile it into a persistent weight modification that activates only when the trigger is present. To preserve stealthiness and benign utility, we impose a null-space constraint so that the injected edit remains dormant on clean inputs. The method is efficient, requiring only a small set of examples and admitting a closed-form solution. Across multiple safety-aligned LLMs and jailbreak benchmarks, our method achieves high triggered attack success while maintaining non-triggered safety and general utility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。