评测大模型在会议纪要生成与问答上的表现,覆盖英捷双语
Findings of the Third Automatic Minuting (AutoMin) Challenge
- 设计多语言、多领域会议纪要生成任务,新增跨语言问答
- 仅两支队伍参与,但提供多个基线模型供评估
- 适合关注大模型在真实会议场景应用的研究者
本文介绍第三届自动会议纪要(AutoMin)共享任务。2025年,AutoMin设立主任务——生成结构化会议纪要,以及新设任务:基于会议转录文本的问答(QA)。纪要任务涵盖英语和捷克语两种语言,以及项目会议和欧洲议会会议两个领域;问答任务仅针对项目会议,分单语(英语)与跨语言(问题用捷克语,答案基于英文会议)两种设置。2025年参与度较往年下降,仅有一队参加纪要任务,两队参与问答任务。作为组织方,我们提供了多个基线系统,以全面评估2025年主流大语言模型(LLMs)在两项任务上的表现。
原文摘要 · Abstract (English)
This paper presents the third edition of AutoMin, a shared task on automatic meeting summarization into minutes. In 2025, AutoMin featured the main task of minuting, the creation of structured meeting minutes, as well as a new task: question answering (QA) based on meeting transcripts. The minuting task covered two languages, English and Czech, and two domains: project meetings and European Parliament sessions. The QA task focused solely on project meetings and was available in two settings: monolingual QA in English, and cross-lingual QA, where questions were asked and answered in Czech based on English meetings. Participation in 2025 was more limited compared to previous years, with only one team joining the minuting task and two teams participating in QA. However, as organizers, we included multiple baseline systems to enable a comprehensive evaluation of current (2025) large language models (LLMs) on both tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。