通过追踪参数来源解决大模型代理的安全粒度错配问题。
The Granularity Mismatch in Agent Security: Argument-Level Provenance Solves Enforcement and Isolates the LLM Reasoning Bottleneck

- 按语义角色追踪参数来源,动态验证调用权限
- 在混合信任场景下实现100%安全与38.1%-46.4%可用性
- 适合需要高安全且容忍推理延迟的复杂代理系统
使用工具的大型语言模型代理需在不信任网页、邮件、文件及API输出上执行特权操作。现有防御通常以整个工具调用为单位进行信任管理,导致混合信任工作流中面临两难:允许外部内容影响调用则可能被劫持,隔离调用又会阻断正常的检索-执行行为。本文关键观察是:间接提示注入的危险性并非源于未受信内容出现在上下文中,而是当其决定了具有权限的参数。为此提出 extsc{PACT}(Provenance-Aware Capability Contracts),一个运行时监控器,能为工具参数分配语义角色,跨重规划步骤追踪值的来源,并检查每个参数的来源是否满足其角色特定的信任合约。在理想溯源条件下, extsc{PACT} 在混合信任诊断套件中实现100%可用性与100%安全性,而传统方法存在误报或漏报。在五种模型的 AgentDojo 部署中, extsc{PACT} 对三个最强模型达到100%安全,同时恢复38.1%–46.4%可用性,较同安全水平下的 CaMeL 高出8–16个百分点。消融实验表明,语义角色与跨步溯源均不可或缺。 extsc{PACT} 将代理安全重新定义为权限绑定问题,并将剩余部署瓶颈定位至溯源推断与合约生成。
原文摘要 · Abstract (English)
Tool-using LLM agents must act on untrusted webpages, emails, files, and API outputs while issuing privileged tool calls. Existing defenses often mediate trust at the granularity of an entire tool invocation, forcing a brittle choice in mixed-trust workflows: allow external content to influence a call and risk hijacked destinations or commands, or quarantine the call and block benign retrieval-then-act behavior. The key observation behind this paper is that indirect prompt injection becomes dangerous not when untrusted content appears in context, but when it determines an authority-bearing argument. We present \textsc{PACT} (\emph{Provenance-Aware Capability Contracts}), a runtime monitor that assigns semantic roles to tool arguments, tracks value provenance across replanning steps, and checks whether each argument's origin satisfies its role-specific trust contract. Under oracle provenance, \textsc{PACT} achieves 100\% utility and 100\% security on mixed-trust diagnostic suites, while flat invocation-level monitors incur false positives or false negatives. In full AgentDojo deployments across five models, \textsc{PACT} reaches 100\% security on the three strongest models while recovering 38.1--46.4\% utility, 8--16 percentage points above CaMeL at the same security level. Ablations show that both semantic roles and cross-step provenance are necessary. \textsc{PACT} reframes agent security as authority binding, and isolates the remaining deployment bottleneck to provenance inference and contract synthesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。