arXiv:2606.10749cs.CRcs.AI2026-06被引 3

系统梳理大模型智能体安全风险与防御,揭示核心威胁与评估短板。

Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation

论文配图:Toward Secure LLM Agents: Threat Surfaces, Attacks, Defenses, and Evaluation
图 1 · 摘自论文原文
  • 基于信息流、权限委托与持久状态构建安全分析框架
  • 提示注入与工具劫持仍是主要攻击,状态污染和多智能体传播成新焦点
  • 现有防御缺乏组合性,评测未覆盖长期状态与真实部署场景

大型语言模型(LLM)智能体正从对话界面转向具备规划、调用工具、记忆维护和外部环境行动能力的软件组件。这一转变改变了安全风险的本质:失败不再仅限于生成不当文本,还可能引发控制流重定向、滥用工具权限、持久状态污染、敏感信息泄露或触发有害外部行为。当前关于LLM智能体安全的研究虽迅速扩展,但分散在不同攻击类型、防御层次、应用领域和评估设置中。本文通过生命周期驱动、系统化的框架,整合247篇文献,围绕四个核心问题展开:如何建模智能体安全、主要威胁面与攻击家族为何、已有防御及其权衡、安全声明如何评估。研究发现,提示注入与工具介导的控制流劫持仍占主导地位,而持久状态污染与多智能体传播成为新兴关键问题。现有防御虽提供有效组件,但组合性弱;现有基准仍低估长周期、状态依赖及部署敏感风险。文章主张,安全的LLM智能体需明确信任边界、原则化权限控制、溯源感知的状态管理,以及贴合真实运行环境的评估实践。

原文摘要 · Abstract (English)

Large language model (LLM) agents are rapidly moving from conversational interfaces to software components that plan, invoke tools, maintain memory, and act on external environments. This transition changes the nature of security risk. In agentic settings, failures are no longer limited to unsafe text generation. Untrusted content may redirect control flow, misuse tool privileges, corrupt persistent state, leak sensitive information, or trigger harmful external actions. At the same time, research on LLM agent security is expanding quickly but remains fragmented across attack families, defense layers, application domains, and evaluation settings. This paper synthesizes 247 papers through a lifecycle-based, systems-oriented framework that models agent security around the interaction of information flow, delegated authority, and persistent state. We organize the literature around four questions: how LLM agent security should be modeled, which threat surfaces and attack families dominate, what defenses have been proposed and with what tradeoffs, and how security claims are evaluated. We find that prompt injection and tool-mediated control-flow hijacking still dominate the field, while persistent state corruption and multi-agent propagation are becoming central emerging concerns. We further find that current defenses provide useful building blocks but remain weakly compositional, and that existing benchmarks still underrepresent long-horizon, stateful, and deployment-sensitive risks. We argue that secure LLM agents require explicit trust boundaries, principled privilege control, provenance-aware state management, and evaluation practices aligned with realistic operational settings.

大模型安全智能体威胁分析防御机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。