arXiv:2607.05120cs.CRcs.AI2026-07被引 1

AI代理面临新型数据注入攻击,威胁其安全执行。

Agent Data Injection Attacks are Realistic Threats to AI Agents

论文配图:Agent Data Injection Attacks are Realistic Threats to AI Agents
图 1 · 摘自论文原文
  • 将恶意数据伪装成可信数据,诱导代理执行错误操作。
  • 实测可导致网页代理任意点击、代码代理远程执行等严重漏洞。
  • 现有防御失效,因代理未隔离信任与非信任数据。

AI代理根据用户指令调用外部数据并执行动作。以往研究多关注间接提示注入(IPI),尤其是指令注入攻击,即攻击者操控的不可信数据被误认为指令。为此已提出多种缓解措施。本文提出一种新类型的IPI——代理数据注入攻击(ADI),通过将恶意数据伪装成可信数据(如关键元数据或代理上下文信息)实现攻击。这使代理在不知情下执行攻击者控制的操作,造成与指令注入类似后果。尽管影响相似,但ADI仍被忽视且可绕过现有防御。我们发现真实代理中存在多个关键漏洞:可在网页代理(Claude in Chrome、Antigravity、Nanobrowser)上实施任意点击攻击,在代码代理(Claude Code、Codex、Gemini CLI)上实现远程代码执行与供应链攻击。评估表明,无论独立LLM还是智能代理系统,ADI均有效。该研究揭示了代理安全的核心缺陷:当前代理未区分可信与不可信数据。

原文摘要 · Abstract (English)

AI agents act on behalf of user prompts, consuming external data and taking actions based on the agent context. Prior research on AI agent security has primarily focused on indirect prompt injection (IPI). Its most well-studied category is instruction injection, where attacker-controlled untrusted data is interpreted as an instruction. In response, many mitigations have been proposed to prevent instruction injection attacks. In this paper, we introduce a new category of IPI, agent data injection attacks (ADI). ADI injects malicious data disguised as trusted data, such as security-critical metadata (e.g., resource identifiers or data origins) or agent context data (e.g., tool call and response formats). As a result, agents unknowingly execute unintended actions based on attacker-controlled data. ADI has similar attack impacts as instruction injection attacks, because it causes agents to misbehave and execute unintended actions. Despite the similar impact, ADI remains underexplored and easily bypasses existing IPI defenses. We found several critical vulnerabilities in real-world agents that allow an attacker to launch various attacks: arbitrary click attacks on web agents (Claude in Chrome, Antigravity, and Nanobrowser), and remote code execution and supply-chain attacks on coding agents (Claude Code, Codex, and Gemini CLI). We evaluate ADI vulnerabilities across off-the-shelf models and AI agents, and find that ADI is effective in both standalone LLMs and AI agent settings. ADI exposes a critical gap in agent security, signifying that current AI agents do not employ a fundamental security principle: current agents do not isolate trusted data from untrusted data.

AI安全数据注入代理攻击

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。