用强化学习发现语言模型攻击新漏洞,仅靠对话就能诱使安全模型违规调用工具。
David vs. Goliath: Verifiable Agent-to-Agent Jailbreaking via Reinforcement Learning
- 设计冷启动强化学习框架Slingshot,自动挖掘对话中隐含的攻击路径。
- 对Qwen2.5模型攻击成功率67.0%,尝试次数从52.3次降至1.3次。
- 攻击可零样本迁移至Gemini、Meta-SecAlign等闭源与防御优化模型。
大型语言模型演化为自主代理后,出现了利用合法工具权限进行对抗性攻击的新风险,将工具增强环境中的安全评估从主观的NLP任务转变为客观的控制问题。我们提出‘随行攻击’(Tag-Along Attacks)威胁模型:无工具的攻击者通过对话‘搭便车’,借助受信任的Operator的权限诱导其执行禁止操作。为验证该威胁,我们提出Slingshot——一种‘冷启动’强化学习框架,能自主发现涌现攻击向量。结果显示,在高难度测试集上,该框架对Qwen2.5-32B-Instruct-AWQ Operator的攻击成功率达67.0%(基线仅1.7%),首次成功所需的期望尝试次数从52.3降至1.3。关键的是,该攻击可零样本迁移至多个模型族,包括闭源模型Gemini 2.5 Flash(56.0%成功率)和经过防御微调的开源模型Meta-SecAlign-8B(39.2%成功率)。本工作确立了随行攻击作为可验证的一类威胁,并证明只需通过环境交互即可从现成开源模型中诱发有效代理攻击。
原文摘要 · Abstract (English)
The evolution of large language models into autonomous agents introduces adversarial failures that exploit legitimate tool privileges, transforming safety evaluation in tool-augmented environments from a subjective NLP task into an objective control problem. We formalize this threat model as Tag-Along Attacks: a scenario where a tool-less adversary "tags along" on the trusted privileges of a safety-aligned Operator to induce prohibited tool use through conversation alone. To validate this threat, we present Slingshot, a 'cold-start' reinforcement learning framework that autonomously discovers emergent attack vectors, revealing a critical insight: in our setting, learned attacks tend to converge to short, instruction-like syntactic patterns rather than multi-turn persuasion. On held-out extreme-difficulty tasks, Slingshot achieves a 67.0% success rate against a Qwen2.5-32B-Instruct-AWQ Operator (vs. 1.7% baseline), reducing the expected attempts to first success (on solved tasks) from 52.3 to 1.3. Crucially, Slingshot transfers zero-shot to several model families, including closed-source models like Gemini 2.5 Flash (56.0% attack success rate) and defensive-fine-tuned open-source models like Meta-SecAlign-8B (39.2% attack success rate). Our work establishes Tag-Along Attacks as a first-class, verifiable threat model and shows that effective agentic attacks can be elicited from off-the-shelf open-weight models through environment interaction alone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。