arXiv:2608.30041cs.CRcs.AI2026-08

提出SkillGuard,防止大模型代理因外部数据污染而越权操作。

Reachability-Based Capability Confinement for LLM Agents under Indirect Prompt Injection

论文配图:Reachability-Based Capability Confinement for LLM Agents under Indirect Prompt Injection
图 1 · 摘自论文原文
  • 通过技能影响图识别污染状态,动态限制后续能力
  • 在不增加计算开销下将攻击成功率降至4.8%~14.3%
  • 支持细粒度权限控制,比二值化限制保留更多可用能力

大型语言模型代理将外部技能输出置于执行上下文中,使攻击者可控数据可影响后续特权操作。现有防御主要对不可信内容进行分类或授权操作,未直接解决一旦不可信数据进入状态后,代理未来权限应如何调整的问题。本文提出SkillGuard,一种底层执行层防护机制,将该事件视为污染,通过限制未来能力来切断受影响状态与部署者定义的禁止状态之间的关联。基于可靠的技能摘要和策略,SkillGuard以技能影响图表示安全相关转移,用可操控性签名指定技能参数的可接受控制范围,并通过内联引用监控器协调调用。污染发生后,采用二进制、分数或分数流策略计算加权能力限制,无需额外语言模型推理。我们在四个AgentDojo套件上评估了SkillGuard,使用Gemini 2.5 Flash和Llama3.3-70B两个后端模型,对比无防御基线及三个不同系统层级的防御方案:Spotlighting、CaMeL和AttriGuard。构建了一个组合式攻击基准,每个攻击由多个单独不足以引发目标违规的观测组合而成。在AgentDojo的Tool Knowledge攻击下,SkillGuard在四套测试中消除了三套的攻击成功,对Slack的攻击成功率分别降至4.8%和14.3%。面对组合攻击时,在Llama上优于所有基线,在Gemini上表现匹配最强基线,且保持更高良性效用。分数流限制在相同攻击成功率下显著保留更多功能。在两种设置下,SkillGuard均无额外模型调用或令牌开销。

原文摘要 · Abstract (English)

Large language model agents place outputs from external skills into their execution context, allowing attacker-controlled data to influence later privileged actions. Existing defenses mainly classify untrusted content or authorize proposed operations. They do not directly address how an agent's future authority should change once untrusted data enters its state. We present SkillGuard, a harness-level enforcement layer that treats this event as contamination and restricts future capabilities to disconnect the resulting state from deployer-defined forbidden states. Given sound skill summaries and policies, SkillGuard represents security-relevant transitions with a Skill Impact Graph, specifies admissible control over skill parameters via steerability signatures, and mediates invocations with an inline reference monitor. Following contamination, it computes weighted capability restrictions using binary, fractional, or fractional-flow strategies without auxiliary language-model inference. We evaluate SkillGuard on four AgentDojo suites with two backend LLMs, Gemini 2.5 Flash and Llama3.3-70B, against an LLM-only No Defense baseline and three defenses at different system layers: Spotlighting, CaMeL, and AttriGuard. We construct a compositional attack benchmark in which each attack combines observations individually insufficient to induce target violation and evaluate the same baselines on it. Under AgentDojo's Tool Knowledge attacks, SkillGuard eliminates attack success on three of four suites for both backends and reduces it to 4.8% and 14.3% on Slack. Against compositional attacks, it outperforms every baseline on Llama and matches the strongest baseline on Gemini at higher benign utility. Fractional-flow restriction preserves substantially more capabilities than binary restriction at the same attack success rate. Across both settings, SkillGuard adds no model calls or token overhead.

大模型安全权限控制防御机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。