arXiv:2606.02640cs.CRcs.AI2026-06

用语义不变的重写干扰攻击反馈,打断多轮越狱攻击链条。

D-Judge: Disrupting Multi-Turn Jailbreaks using Semantics-Preserving Output Rewriting

论文配图:D-Judge: Disrupting Multi-Turn Jailbreaks using Semantics-Preserving Output Rewriting
图 1 · 摘自论文原文
  • 在模型回复前重写内容,保持原意但扭曲攻击者评估信号。
  • 在HarmBench上使顶尖多轮越狱攻击成功率下降,良性任务性能不变。
  • 适合防护大型语言模型免受持续反馈型越狱攻击的场景。

多轮越狱攻击正威胁大语言模型安全,因其利用辅助判断模型的反馈,迭代优化提示以达成有害目标。现有防御多在单轮或最终响应阶段检测或拦截不安全内容,未能切断攻击者依赖的反馈循环,使其仍可从中间交互中获取有效反馈。本文提出D-Judge,一种语义保持的输出重写防御机制,通过在攻击者判断模型评估前修改目标模型的回复,直接干预该反馈循环。该方法通过不改变原意但误导判断模型评分的方式,扰乱攻击者的提示优化过程,使其后续查询基于失真的攻击进展信号进行优化。为提升重写能力,我们构建了一个包含语义等价但判别分数不同的回复对的数据集,并采用监督微调与直接偏好优化进行训练。在HarmBench上的实验表明,D-Judge显著降低当前最先进多轮越狱攻击的成功率,同时保持在良性基准测试中的性能表现。

原文摘要 · Abstract (English)

Multi-turn jailbreak attacks pose a growing threat to large language model (LLM) safety because they exploit feedback from auxiliary judge models to iteratively refine prompts toward harmful goals. Existing defenses largely detect or block unsafe content at individual turns or at the final response, leaving the judge-driven refinement loop intact and allowing attackers to extract informative feedback from intermediate interactions. We introduce D-Judge, a semantics-preserving output rewriting defense that intervenes directly in this loop by rewriting the victim LLM's responses before they are evaluated by the attacker's judge. By misaligning the judge's feedback signal without changing the meaning of the original response, D-Judge derails the attacker's prompt-refinement process, causing subsequent queries to be optimized against a distorted signal of attack progress. To improve D-Judge's ability to produce such rewrites, we construct a dataset of semantically equivalent response pairs that induce different judge-assigned harmfulness scores, and use it for supervised fine-tuning followed by direct preference optimization. Experiments on HarmBench show that D-Judge reduces the success rate of state-of-the-art multi-turn jailbreaks while preserving performance on benign benchmarks.

模型安全越狱防御语义保持多轮攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。