arXiv:2606.00523cs.CL2026-06

让大模型主动判断何时该响应,减少延迟并保持质量。

ProactiveLLM: Learning Active Interaction for Streaming Large Language Models

  • 用模型内部状态判断输入是否足够,决定何时交互。
  • 在文本和语音任务中,交互延迟显著降低,效果不下降。
  • 无需外部标注或强教师模型,适合各类流式场景。

标准大语言模型采用读取完再生成的范式,导致不必要的延迟和计算开销。流式大模型通过边接收边生成缓解此问题,但仍难以确定何时交互。现有方法或硬编码交互时机,或依赖昂贵的外部对齐信号(如时间标签、推理轨迹或强教师模型)。本文提出 ProactiveLLM,通过模型内生状态引导主动交互决策。模型首先通过两种互补训练机制学习从部分输入中感知语义充分性:掩码流建模(mask-based streaming modeling)在训练时对输入施加单调随机掩码,模拟逐步揭示的流式输入,使模型学会从局部输入中捕捉语义依赖;同步特权自蒸馏(SPSD)将同一演化模型生成的部分上下文学生视图与全上下文教师视图对齐,利用特权全上下文信息指导学生在不完备观测下的理解。这两种机制共同催生了无需外部教师或标注的内生充分性提示,为多样化决策头的即插即用集成提供通用基础。在文本和语音流式任务上的广泛评估表明,ProactiveLLM 显著降低交互延迟,同时保持高质量,验证了其动态主动交互能力。代码已公开于 https://github.com/EIT-NLP/StreamingLLM/tree/main/ProactiveLLM。

原文摘要 · Abstract (English)

Standard Large Language Models (LLMs) follow a read-then-generate paradigm, causing unnecessary latency and computation. Streaming LLMs alleviate this issue by generating while receiving inputs, but still struggle to decide when to interact with the stream. Existing methods either hard-code interaction timing or rely on costly external alignment signals, such as timing labels, reasoning trajectories, or stronger teachers. In this paper, we propose ProactiveLLM, which achieves active interaction by leveraging the model's endogenous states to guide interaction decisions. The model first learns to perceive semantic sufficiency from partial inputs through two complementary training mechanisms: mask-based streaming modeling and synchronized privileged self-distillation (SPSD). The former applies monotonic random masking to the input during training, simulating progressively revealed streaming inputs and enabling the model to learn local semantic dependencies from partial-input views. The latter aligns the partial-context student view with a full-context teacher view generated by the same evolving model, allowing privileged full-context evidence to guide the student's understanding under incomplete observations. Together, these mechanisms induce endogenous sufficiency cues without requiring external teachers or annotations, providing a versatile foundation for the plug-and-play integration of diverse decision heads. Extensive evaluation across text and speech streaming tasks confirms that ProactiveLLM significantly reduces interaction latency while maintaining quality, validating its capacity for dynamic and active interaction. Code is publicly available at https://github.com/EIT-NLP/StreamingLLM/tree/main/ProactiveLLM.

流式模型主动交互延迟优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。