arXiv:2603.22061cs.LGcs.AI2026-03被引 3

用主题匹配对比基线反而失效,揭示了拒绝行为消除中的关键设计陷阱。

On the Failure of Topic-Matched Contrast Baselines in Multi-Directional Refusal Abliteration

  • 通过主题匹配的对比基线提取拒绝方向,但效果全失败。
  • 不匹配对比基线在6个层上实现完全拒绝消除,而主题匹配无一成功。
  • 主题匹配会抵消共性激活,导致方向过弱无法生效,适合安全研究者参考。

为从指令微调语言模型中消除拒绝行为,需从残差流激活空间提取相关方向。现有研究将对比基线视为实现细节而非方法论问题。本文在Qwen 3.5 2B模型上,使用类别匹配提示对、每类自组织映射提取及奇异值分解正交化,检验主题匹配对比基线是否更优。结果发现:在任一层、任意权重下,主题匹配对比均未产生有效拒绝方向;而相同模型、代码与评估协议下,不匹配对比在六个层上实现完全拒绝消除。几何分析表明,主题匹配减法会消除有害与无害提示间共享的主导激活成分,使提取方向幅度低于权重矩阵投影可扰动残差流的阈值。论文讨论了该现象对消解研究中对比基线设计的启示。

原文摘要 · Abstract (English)

Inasmuch as the removal of refusal behavior from instruction-tuned language models by directional abliteration requires the extraction of refusal-mediating directions from the residual stream activation space, and inasmuch as the construction of the contrast baseline against which harmful prompt activations are compared has been treated in the existing literature as an implementation detail rather than a methodological concern, the present work investigates whether a topically matched contrast baseline yields superior refusal directions. The investigation is carried out on the Qwen~3.5 2B model using per-category matched prompt pairs, per-class Self-Organizing Map extraction, and Singular Value Decomposition orthogonalization. It was found that topic-matched contrast produces no functional refusal directions at any tested weight level on any tested layer, while unmatched contrast on the same model, same extraction code, and same evaluation protocol achieves complete refusal elimination on six layers. The geometric analysis of the failure establishes that topic-matched subtraction cancels the dominant activation component shared between harmful and harmless prompts of the same subject, reducing the extracted direction magnitude below the threshold at which weight-matrix projection perturbs the residual stream. The implications for the design of contrast baselines in abliteration research are discussed.

模型安全拒绝行为对抗训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。