用外带元数据通道确保智能体安全,防止误操作和篡改。
The Importance of Out-of-Band Metadata for Safe Autonomous Agents: The Redpanda Agentic Data Plane
- 通过独立于智能体路径的外带通道传递安全信息
- 实现数据访问控制、动作约束与不可篡改审计日志
- 适合需要高安全性的企业级智能体系统
AI智能体正被期望作为数字员工,自主访问企业数据、做出决策并执行操作。但它们比人类更不可预测,易受幻觉、误读和恶意攻击影响,同时技术能力更强,能以机器速度快速传播损害。这使得依赖智能体准确解读或传递如访问策略、数据分类、行为限制等关键元数据极不安全。本文提出红熊猫智能体数据平面(ADP),构建于外带元数据通道之上:这些基础设施路径在智能体读写路径之外,跨异构系统确定性地传递安全上下文、策略信号与审计记录。该架构在智能体全生命周期中实施治理——入时限定数据范围,执行中约束行为,出时生成防篡改日志。我们在一个多智能体投资组合再平衡系统中验证了该设计:智能体监控市场、决策交易并执行跨隔离客户账户的操作,所有客户级数据范围、交易审批阈值及防篡改审计日志均由智能体无法窥视或绕过的外带通道强制执行。
原文摘要 · Abstract (English)
AI agents are increasingly expected to operate as digital employees: accessing enterprise data, making decisions, and taking actions autonomously. But agents are simultaneously less predictable than humans -- prone to hallucination, misinterpretation, and adversarial manipulation -- and more technically capable: with deep system knowledge and high-throughput interfaces cascading damage at machine speed. This combination makes it unsafe to rely on agents to faithfully interpret or propagate security-critical metadata such as access policies, data classifications, and behavioral constraints. We present the Redpanda Agentic Data Plane (ADP), an architecture built around out-of-band metadata channels: infrastructure pathways that carry security context, policy signals, and audit trails deterministically, entirely outside the agent's read and write path and across heterogeneous infrastructure. These channels enforce governance at every stage of the agent lifecycle -- scoping data access on the way in, constraining actions during execution, and capturing tamper-proof transcripts on the way out. We demonstrate ADP with a multi-agent portfolio rebalancing system in which autonomous agents monitor markets, make trade decisions, and execute orders across isolated client accounts -- with per-client data scoping, trade approval thresholds, and tamper-proof audit trails all enforced by out-of-band channels the agents can neither see nor bypass.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。