让AI理解模糊指令,提升人机协作准确率。
Gricean Norms as a Basis for Effective Collaboration
- 引入格赖斯合作原则,让AI理解模糊、不完整指令
- 带规则的AI在网格任务中准确率更高,响应更相关
- 适合需要自然语言协作的智能体开发场景
有效的人机协作不仅依赖AI执行明确指令,还需应对沟通中的模糊、不完整、无效或无关信息。本文提出一种规范框架,将格赖斯会话准则(数量、质量、关联性、方式)与共知、相关性理论及心智理论结合,嵌入大语言模型(LLM)代理。该框架使代理能基于格赖斯准则解析模糊指令。我们设计了基于GPT-4的Lamoid代理,对比有无格赖斯准则版本。在网格世界(Doors, Keys, and Gems)任务中,带规则的Lamoid在处理清晰与模糊自然语言指令时,任务准确率更高,生成的回答更清晰、准确且语境相关。结果表明,该规范框架增强了代理的语用推理能力,提升了人机协作效率,推动了上下文感知的对话能力。
原文摘要 · Abstract (English)
Effective human-AI collaboration hinges not only on the AI agent's ability to follow explicit instructions but also on its capacity to navigate ambiguity, incompleteness, invalidity, and irrelevance in communication. Gricean conversational and inference norms facilitate collaboration by aligning unclear instructions with cooperative principles. We propose a normative framework that integrates Gricean norms and cognitive frameworks -- common ground, relevance theory, and theory of mind -- into large language model (LLM) based agents. The normative framework adopts the Gricean maxims of quantity, quality, relation, and manner, along with inference, as Gricean norms to interpret unclear instructions, which are: ambiguous, incomplete, invalid, or irrelevant. Within this framework, we introduce Lamoids, GPT-4 powered agents designed to collaborate with humans. To assess the influence of Gricean norms in human-AI collaboration, we evaluate two versions of a Lamoid: one with norms and one without. In our experiments, a Lamoid collaborates with a human to achieve shared goals in a grid world (Doors, Keys, and Gems) by interpreting both clear and unclear natural language instructions. Our results reveal that the Lamoid with Gricean norms achieves higher task accuracy and generates clearer, more accurate, and contextually relevant responses than the Lamoid without norms. This improvement stems from the normative framework, which enhances the agent's pragmatic reasoning, fostering effective human-AI collaboration and enabling context-aware communication in LLM-based agents.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。