让AI在对话中动态遵守人类规范，避免冲突。
Reasoning and Planning with Dynamically Changing Norms
- 用可撤销逻辑解决规范冲突问题
- 在对话任务中实现规范引导的计划生成
- 适合需理解社会规范的交互式AI研究者
为安全与人类互动，智能体需既了解人类规范，又在规划中加以考虑。然而，现有研究多局限于人工智能体社群内，且忽视了规范的动态性。本文提出一种在人机交互场景中基于动态变化规范进行规划的方法。我们贡献了一种可撤销的规范冲突求解演算，并设计了将动态规范作为计划约束的机制。通过形式化证明和基于自然语言对话任务的实证，使用AI代理SocialBot验证了该方法的有效性。
原文摘要 · Abstract (English)
To safely interact with humans, AI agents must both know our norms and consider them during planning. However, such norm-guided planning has been less explored, only within communities of artificial agents, and has ignored the dynamic nature of norms. This paper instead presents an approach to guiding planning with dynamically changing norms in a human-AI setting. We contribute a defeasible calculus for resolving normative conflicts and an approach to using such dynamically changing norms as guard rails on plans. We theoretically demonstrate our approach with formal proofs and empirically with an AI agent, SocialBot, on a natural language dialogue task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。