arXiv:2602.07652cs.CRcs.AI2026-02AAAI被引 3

提出安全评估框架AgentFence,检测大模型代理的运行漏洞。

Agent-Fence: Mapping Security Vulnerabilities Across Deep Research Agents

  • 从架构出发定义14类安全威胁,通过对话轨迹异常识别风险
  • 不同代理架构安全漏洞率差异显著,最高达51%
  • 授权混淆等操作类漏洞最严重,与目标劫持高度相关

大型语言模型正作为深度代理被部署,具备规划、持久状态和调用外部工具的能力,使安全问题从不安全文本转向不安全行为轨迹。我们提出AgentFence,一种以架构为中心的安全评估方法,定义了涵盖规划、记忆、检索、工具使用和委托的14类信任边界攻击,并通过可追溯的对话中断(如未经授权或不安全的工具调用、错误主体行为、状态/目标完整性破坏及攻击关联偏差)检测失败。在固定基础模型的前提下,对八种代理架构进行持续多轮交互评估,发现平均安全中断率(MSBR)在0.29±0.04(LangGraph)至0.51±0.07(AutoGPT)之间。最高风险类别为操作类:钱包拒绝服务(0.62±0.08)、授权混淆(0.54±0.10)、检索污染(0.47±0.09)和规划操纵(0.44±0.11),而提示驱动类攻击在标准设置下均低于0.20。主要中断类型为边界违规(SIV 31%,WPA 27%,UTI+UTA 24%,ATD 18%),且授权混淆与目标及工具劫持显著相关(ρ≈0.63,ρ≈0.58)。AgentFence将代理安全重新聚焦于其是否在目标与权限范围内长期保持稳定。

原文摘要 · Abstract (English)

Large language models are increasingly deployed as *deep agents* that plan, maintain persistent state, and invoke external tools, shifting safety failures from unsafe text to unsafe *trajectories*. We introduce **AgentFence**, an architecture-centric security evaluation that defines 14 trust-boundary attack classes spanning planning, memory, retrieval, tool use, and delegation, and detects failures via *trace-auditable conversation breaks* (unauthorized or unsafe tool use, wrong-principal actions, state/objective integrity violations, and attack-linked deviations). Holding the base model fixed, we evaluate eight agent archetypes under persistent multi-turn interaction and observe substantial architectural variation in mean security break rate (MSBR), ranging from $0.29 \pm 0.04$ (LangGraph) to $0.51 \pm 0.07$ (AutoGPT). The highest-risk classes are operational: Denial-of-Wallet ($0.62 \pm 0.08$), Authorization Confusion ($0.54 \pm 0.10$), Retrieval Poisoning ($0.47 \pm 0.09$), and Planning Manipulation ($0.44 \pm 0.11$), while prompt-centric classes remain below $0.20$ under standard settings. Breaks are dominated by boundary violations (SIV 31%, WPA 27%, UTI+UTA 24%, ATD 18%), and authorization confusion correlates with objective and tool hijacking ($ρ\approx 0.63$ and $ρ\approx 0.58$). AgentFence reframes agent security around what matters operationally: whether an agent stays within its goal and authority envelope over time.

大模型安全代理系统漏洞检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。