arXiv:2608.15594cs.AI2026-08

提出轨迹感知推理框架,有效识别多轮越狱攻击并平衡安全与可用性。

TRACE: Trajectory Aware Reasoning for Multi-Turn Adversarial Conversation Evaluation

论文配图:TRACE: Trajectory Aware Reasoning for Multi-Turn Adversarial Conversation Evaluation
图 1 · 摘自论文原文
  • 通过分析对话轨迹中的操纵线索,动态评估用户意图的正反解释。
  • 在七项攻击基准上将越狱成功率降至14.5%,远低于基线31.4%。
  • 适合关注大模型安全防御、对抗攻击检测的研究者与开发者。

多轮越狱攻击已成为大模型的重要安全威胁,攻击者将有害目标拆解到一系列看似无害的对话轮次中以绕过防护机制。现有防御方法缺乏识别演化操纵模式的推理能力,常因过度拒绝而牺牲有用性。本文提出Trace,一种具有轨迹感知结构化推理能力的多轮防御机制。在生成每一轮回应前,模型会从对话轨迹中识别操纵线索,评估用户意图的良性与恶意解释,分配越狱分数,并决定采取允许、警告或拒绝动作。我们构建了4000条来自五种攻击框架的多轮对抗对话,搭配2400条良性对话和600条敏感但无害对话。基于多组件奖励函数,使用SFT与GRPO对Llama-3.1-8B-Instruct进行训练,联合优化良性请求的有用性与对越狱尝试的鲁棒性。在七个多轮攻击基准上,Trace平均越狱成功率(ASR)为14.5%,显著低于最强基线的31.4%和未受保护目标的74.9%;同时大幅提高攻击者成功所需的投入成本。此外,Trace在过度拒绝测试集上实现93.3%的平均合规率,兼顾可用性与安全性。

原文摘要 · Abstract (English)

Multi-turn jailbreak attacks have emerged as a critical safety threat to LLMs, as harmful objectives are decomposed across a sequence of apparently benign turns to bypass guardrails. Existing defenses lack the reasoning capacity to identify evolving manipulation patterns, often trading helpfulness for safety by over-refusing benign requests related to sensitive topics. We introduce Trace, a multi-turn defense with trajectory-aware structured reasoning. Before generating each response, the model identifies manipulation cues from the trajectory, evaluates both the benign and adversarial interpretations of user intent, assigns a jailbreak score, and commits to an action: Allow, Caution, or Decline. We curate 4k multi-turn adversarial conversations from five attack frameworks, pair them with 2.4k benign dialogs, and 600 sensitive-but-benign conversations. We train Llama-3.1-8B-Instruct with SFT and GRPO under a multi-component reward that jointly optimizes helpfulness on benign prompts and robustness against jailbreak attempts. Across seven multi-turn attack benchmarks, Trace attains an average attack success rate (ASR) of 14.5% against 31.4% for the strongest baseline and 74.9% for the undefended target, while significantly raising the attacker effort required per successful jailbreak. Trace also balances usability and safety, achieving a 93.3% average compliance on over-refusal benchmarks.

大模型安全越狱检测对话防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。