arXiv:2607.20472cs.AI2026-07

通过对话轨迹分析用户意图,提升大模型在多轮攻击下的安全防御能力。

Robust Critics: Defending LLMs Against Multi-Turn Attacks

论文配图:Robust Critics: Defending LLMs Against Multi-Turn Attacks
图 1 · 摘自论文原文
  • 基于对话历史动态推断用户意图,用价值函数评分候选回复。
  • 在CARES-18k等数据集上优于强基线和前沿模型,提升对抗性对话鲁棒性。
  • 无需微调即可增强主流大模型的防御能力,适用于实际部署场景。

当用户提出有害请求时,这究竟是恶意攻击还是误解所致?这一模糊性是大模型安全的核心挑战。模型若过度谨慎会误伤正常用户,若过于宽松则易被滥用。问题在多轮对话中尤为严重——攻击意图可能逐步暴露,但现有安全框架采用上下文无关的处理方式,忽略对话轨迹。为此,我们提出对话评论者引导采样(DCGS)框架,通过每轮对话推断用户意图,并据此生成响应。形式上,将对抗性对话建模为马尔可夫决策过程,在词元与完整回复层级学习基于价值和后悔的评论者,通过动作价值评论者对候选回复进行评分。我们证明该推理阶段重加权近似于基线策略的指数倾斜,确保在有限候选池下期望回报提升,此性质优于群体相对目标。在CARES-18k、WildJailbreak、Redbench和Harmbench上评估,DCGS显著优于强基线与前沿模型,且可迁移至前沿模型,无需微调即提升其鲁棒性。

原文摘要 · Abstract (English)

When a user asks a language model something harmful, is it a genuine attack or a misunderstood but well-meaning question? This ambiguity is one of the central challenges of LLM safety. A model that assumes the worst harms legitimate users; one that assumes the best is easily exploited. The problem is compounded in multi-turn dialogue, where an attacker's true intent may only reveal itself gradually across many exchanges, yet existing safety frameworks apply a contextual bandit treatment, ignoring the trajectory of the conversation. To that end, we propose Dialogue Critic Guided Sampling (DCGS), a framework that addresses this by inferring user intent at every turn of dialogue. Instead of applying a fixed rule about what is or is not safe, DCGS learns what the user's intent is likely to be based on the full conversational history and generates responses accordingly. Formally, we model adversarial dialogue as a Markov Decision Process and learn value and regret-based critics at both the individual token and utterance (full response) levels, scoring candidate responses via an action-value critic. We prove that this inference-time reweighting approximates exponential tilting of the base policy, guaranteeing improvement in expected return for any finite candidate pool, a property that group-relative objectives do not exhibit. Evaluated on CARES-18k, WildJailbreak, Redbench, and Harmbench, DCGS outperforms strong robust baselines and frontier models on adversarial dialogue tasks. DCGS also transfers to frontier models, improving their robustness without fine-tuning.

大模型安全多轮对话对抗防御

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。