发现工具调用大模型中的因果泄露漏洞,提出实时防护机制。
Causality Laundering: Denial-Feedback Leakage in Tool-Calling LLM Agents
- 通过构建带反事实边的因果溯源图,追踪被拒调用引发的间接影响。
- 在三个攻击场景中完全阻断因果泄露和跨域数据污染,延迟低于1毫秒。
- 适合安全研究人员和大模型系统开发者参考,提升工具调用安全性。
工具调用的大语言模型代理可读取私有数据、调用外部服务并触发现实操作,带来执行点的安全风险。我们识别出一种称为‘因果清洗’的拒绝反馈泄露模式:攻击者探测受保护操作,从拒绝结果中学习信息,并通过后续看似无害的工具调用将推断出的信息外泄。该攻击无法被传统扁平溯源追踪捕获,因其源于被拒操作的因果影响而非直接数据流。本文提出代理参考监控器(ARM),一个运行时强制层,通过查询涵盖工具调用、返回数据、字段级溯源及被拒操作的溯源图,来中介每次工具调用。ARM通过完整性格传播信任,并在被拒操作节点上添加反事实边,实现对传递性数据依赖和拒绝引发的因果影响的双重控制。在三个代表性攻击场景的受控评估中,ARM成功阻止了因果清洗、传递性污染和混合溯源字段误用,而基准的扁平溯源方案未能发现这些问题,同时政策评估开销低于亚毫秒。结果表明,具备拒绝感知的因果溯源是保障工具调用代理系统安全的有效抽象。
原文摘要 · Abstract (English)
Tool-calling LLM agents can read private data, invoke external services, and trigger real-world actions, creating a security problem at the point of tool execution. We identify a denial-feedback leakage pattern, which we term causality laundering, in which an adversary probes a protected action, learns from the denial outcome, and exfiltrates the inferred information through a later seemingly benign tool call. This attack is not captured by flat provenance tracking alone because the leaked information arises from causal influence of the denied action, not direct data flow. We present the Agentic Reference Monitor (ARM), a runtime enforcement layer that mediates every tool invocation by consulting a provenance graph over tool calls, returned data, field-level provenance, and denied actions. ARM propagates trust through an integrity lattice and augments the graph with counterfactual edges from denied-action nodes, enabling enforcement over both transitive data dependencies and denial-induced causal influence. In a controlled evaluation on three representative attack scenarios, ARM blocks causality laundering, transitive taint propagation, and mixed-provenance field misuse that a flat provenance baseline misses, while adding sub-millisecond policy evaluation overhead. These results suggest that denial-aware causal provenance is a useful abstraction for securing tool-calling agent systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。