arXiv:2409.13715cs.CLcs.AI2024-09被引 3

首个多人对话记忆数据集,用于建模人类对话记忆与群体互动。

Introducing MeMo: A Multimodal Dataset for Memory Modelling in Multiparty Conversations

  • 构建包含31小时多人对话的多模态数据集,含记忆报告
  • 重复3轮2周实验,记录参与者对对话内容的记忆差异
  • 适合研究社交关系长期发展与智能对话系统设计

对话记忆是人类对对话中的语言、非语言及情境信息进行编码、保持和提取的过程。由于记忆具有选择性,同一事件的不同回忆可能导致群体内误解和认知偏差。然而,多数对话引导系统仅关注单会话内的用户状态追踪,忽略了交互后个体留存的记忆。理解对话记忆可作为社会关系长期发展的信息来源。本文提出MeMo语料库,首个标注了参与者记忆保留报告的对话数据集,旨在推动人机对话记忆的计算建模。该语料库包含31小时关于新冠疫情的小型团体讨论,持续两周并重复3次。数据集融合经验证的行为与感知测量、音频、视频及多模态标注,为研究对话记忆与群体动态提供宝贵资源。通过分析其有效性并展示其研究潜力,本文旨在为未来对话记忆建模与智能系统开发铺平道路。

原文摘要 · Abstract (English)

Conversational memory is the process by which humans encode, retain and retrieve verbal, non-verbal and contextual information from a conversation. Since human memory is selective, differing recollections of the same events can lead to misunderstandings and misalignments within a group. Yet, conversational facilitation systems, aimed at advancing the quality of group interactions, usually focus on tracking users' states within an individual session, ignoring what remains in each participant's memory after the interaction. Understanding conversational memory can be used as a source of information on the long-term development of social connections within a group. This paper introduces the MeMo corpus, the first conversational dataset annotated with participants' memory retention reports, aimed at facilitating computational modelling of human conversational memory. The MeMo corpus includes 31 hours of small-group discussions on Covid-19, repeated 3 times over the term of 2 weeks. It integrates validated behavioural and perceptual measures, audio, video, and multimodal annotations, offering a valuable resource for studying and modelling conversational memory and group dynamics. By introducing the MeMo corpus, analysing its validity, and demonstrating its usefulness for future research, this paper aims to pave the way for future research in conversational memory modelling for intelligent system development.

对话记忆多模态数据集群体互动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。