用逻辑推理模块分离道德判断与执行,让AI决策更安全可解释。
Breaking Up with Normatively Monolithic Agency with GRACE: A Reason-Based Neuro-Symbolic Architecture for Safe and Ethical AI Alignment
- 分三模块:道德模块用逻辑推理判断是否合规,执行模块选最优动作,守卫模块监督合规性。
- 通过符号化表达实现行为可解释、可辩论、可验证,支持形式化验证与统计保障。
- 适合需高安全性和伦理可审计的AI应用,如医疗辅助、自动驾驶等场景。
随着AI代理在关键场景中日益自主且影响真实世界,确保其决策不仅有效率,还符合规范准则变得至关重要。我们提出一种神经符号式基于理由的约束架构——道德对齐约束管理者(GRACE),将规范性推理与工具性决策解耦,适用于几乎任何设计的AI代理。GRACE将决策过程重构为三个模块:道德模块(MM)通过基于义务逻辑的推理决定允许的宏观动作;决策模块(DMM)封装目标代理,在遵循推导出的宏观动作下选择工具最优的原始动作;守卫模块监控并强制道德合规。MM采用基于理由的形式化体系,为义务逻辑提供语义基础,实现可解释性、可争辩性和可辩护性。其符号化表示丰富了DMM的信息上下文,并支持由守卫实施的对齐性形式化验证与统计保证。我们在一个大型语言模型治疗助手的例子中展示了GRACE,证明其使利益相关方能够理解、质疑并优化代理行为。
原文摘要 · Abstract (English)
As AI agents become increasingly autonomous, widely deployed in consequential contexts, and efficacious in bringing about real-world impacts, ensuring that their decisions are not only instrumentally effective but also normatively aligned has become critical. We introduce a neuro-symbolic reason-based containment architecture, Governor for Reason-Aligned ContainmEnt (GRACE), that decouples normative reasoning from instrumental decision-making and can contain AI agents of virtually any design. GRACE restructures decision-making into three modules: a Moral Module (MM) that determines permissible macro actions via deontic logic-based reasoning; a Decision-Making Module (DMM) that encapsulates the target agent while selecting instrumentally optimal primitive actions in accordance with derived macro actions; and a Guard that monitors and enforces moral compliance. The MM uses a reason-based formalism providing a semantic foundation for deontic logic, enabling interpretability, contestability, and justifiability. Its symbolic representation enriches the DMM's informational context and supports formal verification and statistical guarantees of alignment enforced by the Guard. We demonstrate GRACE on an example of a LLM therapy assistant, showing how it enables stakeholders to understand, contest, and refine agent behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。