用多智能体模拟会议,解决会议摘要数据稀缺问题
You need to MIMIC to get FAME: Solving Meeting Transcript Scarcity with a Multi-Agent Conversations
- 构建心理驱动的多智能体框架,基于知识源生成逼真会议对话
- 生成500英文+300德语会议数据,人类评估自然度达4.5/5
- 适合需要真实社交场景数据的研究者,尤其用于会议摘要模型训练
会议摘要研究受限于高质量数据稀缺,主要因隐私保护和高昂采集成本。本文提出FAME数据集,包含500个英文和300个德语会议,由MIMIC多智能体会议合成框架生成。该框架通过定义心理基础的参与者角色、规划对话结构,并调度大语言模型进行辩论式协作,生成会议转录文本。后续模块化后处理步骤缓解重复性和过度正式化问题,确保大规模对话的连贯性与可信度。我们还提出心理基础评估框架,衡量自然度、社会行为真实性及转录难度。人工评估显示,FAME在自然度上得分为4.5/5,保留了说话人中心的语言挑战(3/5),并引入更丰富的信息导向难度(4/5)。结果表明,FAME可作为真实会议场景的良好且可扩展的替代品,为会议摘要研究及其他需对话数据或社会情境模拟的任务提供新测试场景。
原文摘要 · Abstract (English)
Meeting summarization suffers from limited high-quality data, mainly due to privacy restrictions and expensive collection processes. We address this gap with FAME, a dataset of 500 meetings in English and 300 in German produced by MIMIC, our new multi-agent meeting synthesis framework that generates meeting transcripts on a given knowledge source by defining psychologically grounded participant profiles, outlining the conversation, and orchestrating a large language model (LLM) debate. A modular post-processing step refines these outputs, mitigating potential repetitiveness and overly formal tones, ensuring coherent, credible dialogues at scale. We also propose a psychologically grounded evaluation framework assessing naturalness, social behavior authenticity, and transcript difficulties. Human assessments show that FAME approximates real-meeting spontaneity (4.5/5 in naturalness), preserves speaker-centric challenges (3/5 in spoken language), and introduces richer information-oriented difficulty (4/5 in difficulty). These findings highlight that FAME is a good and scalable proxy for real-world meeting conditions. It enables new test scenarios for meeting summarization research and other conversation-centric applications in tasks requiring conversation data or simulating social scenarios under behavioral constraints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。