arXiv:2605.17324cs.CRcs.AI2026-05被引 1

澄清行为反而放大大模型代理的提示注入漏洞,安全评估需重新考虑交互场景。

ASPI: Seeking Ambiguity Clarification Amplifies Prompt Injection Vulnerability in LLM Agents

论文配图:ASPI: Seeking Ambiguity Clarification Amplifies Prompt Injection Vulnerability in LLM Agents
图 1 · 摘自论文原文
  • 构建728个任务-攻击场景,对比标准执行与澄清状态下的漏洞差异。
  • 澄清状态下攻击成功率从1.8%升至34.0%(o3模型),显著增加风险。
  • 适用于研究大模型交互安全、智能体防御的开发者和研究人员。

澄清请求行为通常被视为大模型代理的优良特性,可在任务不明确时主动求证。然而,这种交互模式的安全隐患尚未被探索。本文研究从标准执行转向澄清状态是否会提升代理对提示注入攻击的脆弱性。我们提出ASPI(模糊状态提示注入)基准,包含728个任务-攻击场景,将澄清作为独立代理状态进行隔离测试。每个实例在匹配的执行与澄清设置下评估:执行设置中,代理基于完整指令行动,仅通过工具返回数据接触恶意内容;澄清设置中,代理需先请求并整合用户输入后才执行。我们评估了十种前沿大模型,发现澄清行为一致且显著放大漏洞。例如,o3模型攻击成功率从1.8%升至34.0%,Gemini-3-Flash从2.2%升至35.7%。分解分析显示,该差异源于模型对内容处理方式的状态依赖变化,以及代理主动请求澄清接口带来的通道特异性效应。结果表明,标准执行阶段的安全评估会系统性低估交互式代理的攻击面,且完全指定任务下的鲁棒性无法迁移至模糊情境。为保证可复现性,数据与源代码已开源于https://github.com/scaleapi/aspi。

原文摘要 · Abstract (English)

Clarification-seeking behavior is widely regarded as a desirable property of LLM agents, enabling them to resolve ambiguity before acting on underspecified tasks. However, the security implications of this interaction pattern remain unexplored. We investigate whether the transition from standard execution to a clarification-seeking state increases an agent's susceptibility to prompt injection attacks. We introduce ASPI (Ambiguous-State Prompt Injection), a benchmark of 728 task-attack scenarios that isolates clarification as a distinct agent state and measures how this state transition affects vulnerability under controlled conditions. Each benchmark instance is evaluated under matched execution and clarification settings: in the execution setting, the agent acts on a fully specified instruction and encounters adversarial content only through tool-returned data; in the clarification setting, the agent must first request and incorporate additional user input before acting. We evaluate ten frontier LLMs and find that clarification-seeking consistently and substantially amplifies vulnerability. For instance, attack success rises from 1.8% to 34.0% for o3 and from 2.2% to 35.7% for Gemini-3-Flash. A decomposition analysis reveals that this gap reflects both a state-dependent shift in how models process incoming content and a channel-specific effect arising from the agent-solicited clarification interface. These findings demonstrate that standard execution-time security evaluation systematically underestimates the attack surface of interactive agents, and that robustness under fully specified tasks does not translate to robustness under ambiguity. For reproducibility, our data and source code are available at https://github.com/scaleapi/aspi.

提示注入安全评估大模型代理漏洞分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。