arXiv:2412.04937cs.CLcs.AI2024-12被引 14

用推理游戏训练AI对话,让多智能体更自然地轮流发言。

Who Speaks Next? Multi-party AI Discussion Leveraging the Systematics of Turn-taking in Murder Mystery Games

  • 基于对话中的配对结构和轮换规律设计发言选择机制
  • 对话中断率显著降低,信息共享与逻辑推理能力提升
  • 适合研究多智能体协作与自然对话的学者或开发者

多智能体系统利用大语言模型在实现自然对话方面展现出巨大潜力,但对话控制与自主决策仍面临挑战。本研究聚焦会话分析中的邻接对与轮换规律,提出名为「谋杀谜案智能体」的新框架,将其应用于AI智能体的对话控制。以需要复杂社会推理与信息操作的“谋杀谜案”桌游为评估场景,玩家需基于碎片化信息通过合作与谈判揭开真相。该框架结合邻接对的下一发言者选择机制与考虑智能体内状态的自选机制,实现更自然且具策略性的对话。通过分析导致对话中断的语句、使用大语言模型进行自动评估,并开展基于谋杀谜案评价标准的人类评估,实验表明:引入下一发言者选择机制显著减少了对话中断,提升了智能体间的信息共享与逻辑推理能力。研究结果证明,人类对话中的轮换规律同样适用于控制AI智能体间的对话,为更先进的多智能体对话系统提供了设计指南。

原文摘要 · Abstract (English)

Multi-agent systems utilizing large language models (LLMs) have shown great promise in achieving natural dialogue. However, smooth dialogue control and autonomous decision making among agents still remain challenges. In this study, we focus on conversational norms such as adjacency pairs and turn-taking found in conversation analysis and propose a new framework called "Murder Mystery Agents" that applies these norms to AI agents' dialogue control. As an evaluation target, we employed the "Murder Mystery" game, a reasoning-type table-top role-playing game that requires complex social reasoning and information manipulation. In this game, players need to unravel the truth of the case based on fragmentary information through cooperation and bargaining. The proposed framework integrates next speaker selection based on adjacency pairs and a self-selection mechanism that takes agents' internal states into account to achieve more natural and strategic dialogue. To verify the effectiveness of this new approach, we analyzed utterances that led to dialogue breakdowns and conducted automatic evaluation using LLMs, as well as human evaluation using evaluation criteria developed for the Murder Mystery game. Experimental results showed that the implementation of the next speaker selection mechanism significantly reduced dialogue breakdowns and improved the ability of agents to share information and perform logical reasoning. The results of this study demonstrate that the systematics of turn-taking in human conversation are also effective in controlling dialogue among AI agents, and provide design guidelines for more advanced multi-agent dialogue systems.

多智能体对话系统推理游戏轮换机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。