让大模型学会在对话中判断何时发言,提升主动协作能力。
DiscussLLM: Teaching Large Language Models When to Speak
- 设计两阶段数据生成流程,构建大规模多人对话数据集。
- 训练模型预测沉默标记,仅在必要时才发言,提升响应时机准确性。
- 适合需要主动参与的智能助手、教育机器人等场景。
大型语言模型在理解和生成类人文本方面表现出色,但大多作为被动响应者,仅在被直接提问时才回应。这种被动性导致‘意识差距’,限制其作为动态人类讨论中真正协作伙伴的潜力。我们提出DiscussLLM框架,通过训练模型主动决策‘何时’发言,弥合这一差距。核心贡献是可扩展的两阶段数据生成管道,合成大规模真实多轮对话数据集,每段对话标注五种干预类型(如事实修正、概念定义),并包含明确的对话触发点,表明AI介入能增加价值。通过训练模型在无需干预时预测特殊静默标记,使其学会在有帮助时才发声。我们探索两种架构:端到端整合模型和解耦的分类-生成系统,后者优化低延迟推理。评估表明,模型能准确把握干预时机并生成有用回应,推动更情境感知的主动对话式AI发展。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated remarkable capabilities in understanding and generating human-like text, yet they largely operate as reactive agents, responding only when directly prompted. This passivity creates an "awareness gap," limiting their potential as truly collaborative partners in dynamic human discussions. We introduce $\textit{DiscussLLM}$, a framework designed to bridge this gap by training models to proactively decide not just $\textit{what}$ to say, but critically, $\textit{when}$ to speak. Our primary contribution is a scalable two-stage data generation pipeline that synthesizes a large-scale dataset of realistic multi-turn human discussions. Each discussion is annotated with one of five intervention types (e.g., Factual Correction, Concept Definition) and contains an explicit conversational trigger where an AI intervention adds value. By training models to predict a special silent token when no intervention is needed, they learn to remain quiet until a helpful contribution can be made. We explore two architectural baselines: an integrated end-to-end model and a decoupled classifier-generator system optimized for low-latency inference. We evaluate these models on their ability to accurately time interventions and generate helpful responses, paving the way for more situationally aware and proactive conversational AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。