构建多轮跨会话对话系统,实现与不同伙伴的连续自然交流。
Mixed-Session Conversation with Egocentric Memory
- 基于主角视角设计动态记忆机制,支持跨会话持续记忆。
- 新数据集MiSC含6轮对话、4名参与者,模拟真实社交场景。
- 适合研究长期对话、多角色交互与记忆管理的学者。
近期对话系统已展现高可用性,但仍难以反映真实对话场景。现有系统无法模拟涉及多个参与者的动态、连续、长期互动。这一局限源于对两类真实对话特征关注不足:长期深层交互与广泛扩展的对话网络。为此,我们提出混合会话对话(Mixed-Session Conversation)框架,在多轮对话设置下构建与不同伙伴的连贯交流。我们构建了新数据集MiSC,每条对话包含6个连续会话,4名说话人(1名主讲者+3名伙伴)。同时提出新型对话模型EMMA,采用主角视角的记忆管理机制,使主讲者在与不同伙伴对话中保留并延续记忆,确保后续互动无缝衔接。人类评估显示,MiSC生成的对话即使更换伙伴也保持流畅;训练于MiSC的EMMA在整段对话中保持高记忆性且无矛盾。
原文摘要 · Abstract (English)
Recently introduced dialogue systems have demonstrated high usability. However, they still fall short of reflecting real-world conversation scenarios. Current dialogue systems exhibit an inability to replicate the dynamic, continuous, long-term interactions involving multiple partners. This shortfall arises because there have been limited efforts to account for both aspects of real-world dialogues: deeply layered interactions over the long-term dialogue and widely expanded conversation networks involving multiple participants. As the effort to incorporate these aspects combined, we introduce Mixed-Session Conversation, a dialogue system designed to construct conversations with various partners in a multi-session dialogue setup. We propose a new dataset called MiSC to implement this system. The dialogue episodes of MiSC consist of 6 consecutive sessions, with four speakers (one main speaker and three partners) appearing in each episode. Also, we propose a new dialogue model with a novel memory management mechanism, called Egocentric Memory Enhanced Mixed-Session Conversation Agent (EMMA). EMMA collects and retains memories from the main speaker's perspective during conversations with partners, enabling seamless continuity in subsequent interactions. Extensive human evaluations validate that the dialogues in MiSC demonstrate a seamless conversational flow, even when conversation partners change in each session. EMMA trained with MiSC is also evaluated to maintain high memorability without contradiction throughout the entire conversation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。