针对代理AI治理中可信中心的漏洞,提出多类防御方案以应对恶意管理员攻击。
Attacks and Mitigations for Distributed Governance of Agentic AI under Byzantine Adversaries

- 设计SAGA-BFT等三类架构,通过拜占庭容错、监控与审计增强安全性
- 实测证明新方案在保持高安全性的前提下,性能损失显著低于传统方法
- 适用于云环境中的代理AI系统,尤其适合对安全要求高的私有部署场景
代理AI治理是保障智能体遵循用户通信与交互策略的关键基础设施,可抵御恶意代理攻击。现有方案SAGA依赖一个逻辑上集中的信任点——提供者(Provider),用于存储用户与代理信息并主动执行策略。然而,当提供者被攻破时,其可能偏离协议,破坏身份与访问控制机制。无论私有云还是公有云部署,内部威胁均加剧了提供者被攻陷的风险。本文分析了从被控提供者发起的多种攻击,包括削弱代理可追溯性、窃取私有数据及绕过访问控制。为此,提出三类解决方案:全拜占庭容错的SAGA-BFT,开销较大但安全性最强;基于轻量级服务端监控的SAGA-MON和客户端审计的SAGA-AUD,以极小代价防御多数攻击;以及结合拜占庭容错与监控审计的混合架构SAGA-HYB,实现安全与性能的权衡。实验评估所有架构并与SAGA对比,讨论各方案适用条件。
原文摘要 · Abstract (English)
Agentic AI governance is a critical component of agentic AI infrastructure ensuring that agents follow their owner's communication and interaction policies, and providing protection against attacks from malicious agents. The state-of-the-art solution, SAGA, assumes a logically centralized point of trust, the Provider, which serves as a repository for user and agent information and actively enforces policies. While SAGA provides protection against malicious agents, it remains vulnerable to a malicious Provider that deviates from the protocol, undermining the security of the identity and access control infrastructure. Deployment on both private and public clouds, each susceptible to insider threats, further increases the risk of Provider compromise. In this work, we analyze the attacks that can be mounted from a compromised Provider, taking into account the different system components and realistic deployments. We identify and execute several concrete attacks with devastating effects: undermining agent attributability, extracting private data, or bypassing access control. We then present three types of solutions for securing the Provider that offer different trade-offs between security and performance. We first present SAGA-BFT, a fully byzantine-resilient architecture that provides the strongest protection, but incurs significant performance degradation, due to the high-cost of byzantine resilient protocols. We then propose SAGA-MON and SAGA-AUD, two novel solutions that leverage lightweight server-side monitoring or client-side auditing to provide protection against most classes of attacks with minimal overhead. Finally, we propose SAGA-HYB, a hybrid architecture that combines byzantine-resilience with monitoring and auditing to trade-off security for performance. We evaluate all the architectures and compare them with SAGA. We discuss which solution is best and under what conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。