用道德化策略约束智能体行为,解决AI系统治理难题。
Deontic Policies for Runtime Governance of Agentic AI Systems

- 基于德性政策语言构建运行时治理框架
- 支持义务、豁免与策略冲突的动态处理
- 适合企业级AI安全与合规管理场景
由大语言模型驱动的自主智能体系统带来了新的安全、隐私和合规挑战:能够调用工具、操作数据、安装软件并跨组织边界协同的智能体,必须不仅依赖认证和访问控制,还需遵循企业治理的完整结构。这包括明确智能体被允许或禁止的行为、特定操作后必须履行的义务(如通知首席信息安全官)、在何种条件下可豁免持续义务,以及规则冲突时的优先级判定。现有策略引擎(如XACML、Rego、Cedar)仅能处理允许/禁止部分,缺乏对义务生命周期管理、元策略冲突解决、特定情境下义务豁免,以及医疗、网络安全、数据隐私等应用中常见的领域类层次推理的支持。我们提出AgenticRei,通过基于Rei框架的德性策略语言(以OWL表达),由运行时外的高性能逻辑引擎执行,实现义务、豁免、冲突化解及策略推理,并统一治理智能体工具调用与代理间通信。实例表明,德性策略可捕捉当前生产引擎无法表达的安全与隐私治理约束。该方法可自然集成于A2AS等行业标准框架。
原文摘要 · Abstract (English)
Autonomous agentic AI systems driven by Large Language Models (LLMs) introduce a new class of security, privacy, and compliance challenges: an agent that can invoke tools, manipulate data, install software, and coordinate with peer agents across organizational boundaries must be constrained not just by authentication and access control, but by the full structure of enterprise governance. This includes specifying what agents are permitted and prohibited from doing, what they areobliged to do after certain actions (e.g., notify the CISO), under what conditions a standing obligation may be waived, and which rules take precedence when policies conflict. This governance problem exceeds what current policy engines provide. Systems such as XACML, Rego, and Cedar address only the permit/prohibit subset of this governance structure. They do not provide obligation lifecycle management, meta-policy conflict resolution, dispensations that waive obligations in specific circumstances, and ontological reasoning over domain class hierarchies commonly found in applications such as healthcare, cybersecurity, or data privacy. We propose AgenticRei, which realizes key governance requirements such as obligations, dispensations, policy conflict resolutions, and reasoning over policies, as well as the basic permit/prohibit constraints. We use a deontic policy language built on the Rei framework, expressed as OWL (Web Ontology Language) and evaluated at runtime by a high-performance logic engine entirely outside the LLM. The same pipeline governs both tool invocations by the agent and agent-to-agent messages. We show through examples that deontic policies capture governance constraints around security and privacy that mostly cannot be expressed in current production engines. Our approach composes naturally with industry-standard frameworks like A2AS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。