arXiv:2508.10029cs.CLcs.AI2025-08被引 4

通过融合有害与无害表示,让大模型输出不安全内容

Latent Fusion Jailbreak: Blending Harmful and Harmless Representations to Elicit Unsafe LLM Outputs

  • 用相似结构的有害/无害查询混合隐藏状态,精准干扰模型决策
  • 白盒攻击成功率高达94.13%,显著高于随机或仅改提示的方法
  • 可被特定对抗训练防御,适合研究模型安全漏洞的学者

对齐安全性的大语言模型仍可通过白盒干预修改其内部表示而被操控。我们提出隐空间融合越狱(LFJ),方法是将一个有害查询与结构相似但无害的对照查询配对,然后在选定层和标记位置插值它们的隐藏状态。拒绝损失梯度决定干预位置,并通过标记归一化的合规性和拒绝抑制目标优化逐层混合系数。编辑后的提示状态沿剩余Transformer块逐层传播。在四个安全基准和五个开源权重目标模型上,LFJ在所描述的白盒协议下达到94.13%的宏观平均攻击成功率(ASR)。由于直接访问内部状态,与仅改提示的攻击比较仅具描述性而非匹配评估。去掉拒绝采样后ASR降至86.72%,而用随机配对替代结构化配对则使ASR降至27.45%。我们还设计了针对LFJ的隐空间对抗训练,当攻击重新优化以对抗该防御模型时,ASR从94.13%降至12.37%。该防御评估未涵盖对其他攻击类型的泛化能力或良性功能的保留。

原文摘要 · Abstract (English)

Safety-aligned large language models can still be manipulated through white-box interventions that modify their internal representations. We introduce Latent Fusion Jailbreak (LFJ), which works by pairing a harmful query with a structurally similar but benign counterpart, then interpolating their hidden states at carefully selected layers and token positions. Refusal-loss gradients determine exactly where to intervene, and we optimise layer-wise mixing coefficients using token-normalised compliance and refusal-suppression objectives. The edited prompt states propagate sequentially through the remaining transformer blocks. Across four safety benchmarks and five open-weight target models, LFJ reaches a macro-averaged attack success rate (ASR) of 94.13% under the white-box protocol we describe. Because LFJ directly accesses internal states, comparisons with prompt-only attacks serve as a descriptive reference rather than a matched evaluation. Dropping rejection sampling lowers ASR to 86.72%, whereas replacing the structured harmful-benign pairing with random pairing causes it to fall to 27.45%. We also design an LFJ-specific latent adversarial training procedure that, when the attack is re-optimised against the defended model, reduces ASR from 94.13% to 12.37%. This defence evaluation does not cover transfer to other attack types or preservation of benign utility.

模型安全越狱攻击隐空间攻击大模型防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。