arXiv:2607.22024cs.CRcs.AI2026-07被引 1

重新定义智能体安全:从看指令内容转向看上下文授权

Agent Security Needs Redefinition through a Holistic Framework

论文配图:Agent Security Needs Redefinition through a Holistic Framework
图 1 · 摘自论文原文
  • 以权限上下文为核心,建立四维安全评估框架
  • 同一操作在不同上下文中可能合法或恶意,仅看内容会误判
  • 适合研究智能体安全机制与攻防评测的学者

当前智能体安全主要关注指令内容是否恶意,但事实上安全本质是上下文问题。例如‘删除用户数据’可能是正常运维请求,也可能是攻击性提示注入,仅凭内容无法区分。本文提出基于四个连续评估属性的上下文安全框架:源授权(Source Authorization)、任务对齐(Task Alignment)、动作对齐(Action Alignment)和数据隔离(Data Isolation)。在AgentDojo和WASP的所有注入任务中,相同动作在授权用户日常流程中本属合理,说明现有内容导向评价存在结构性缺陷。间接提示注入本质上是源授权违规,而现有快照基准无法评估数据隔离。该框架重构了防御措施的逻辑基础,明确了哪些防御真正有效、哪些评测有意义、哪些攻击模式能被发现。

原文摘要 · Abstract (English)

Agent security is widely treated as a question about action content. Defenses ask whether an instruction looks malicious. Benchmarks ask whether an agent performs a harmful sounding action. \textbf{We argue that agent security is fundamentally a contextual problem, and that the current content based framing systematically misdefines it.} A command to ``delete user data'' might be a routine administrative request or a prompt injection attacking production systems, and the content alone cannot distinguish the two. Authorization context can. Across every injection task in AgentDojo and WASP, the same action is one an authenticated user would plausibly request in a routine workflow, which makes the conflation a structural property of evaluating security through content. We operationalize contextual security through four properties that must hold jointly and be evaluated continuously across the agent's trajectory. Source Authorization asks who issued the command. Task Alignment specifies the agent's authorized objective. Action Alignment evaluates whether each action serves that objective. Data Isolation governs information flows across privilege boundaries. Under this reframing, indirect prompt injection becomes a Source Authorization violation. Snapshot benchmarks are structurally incapable of evaluating Data Isolation. Existing defenses are reorganized around the property they actually approximate. The contextual reframing changes which defenses are coherent, which evaluations measure something useful, and which attack patterns evaluation can see at all.

智能体安全上下文推理提示注入权限控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。