让大模型学会在听语音时判断何时思考、何时回应,提升实时对话质量。
Learning When to Think While Listening in Large Audio-Language Models

- 设计可学习的等待-思考-回答控制机制,根据部分语音证据动态决策
- 在合成数据上准确率提升至70.3%,且响应延迟后置14%
- 适用于需要实时交互的语音问答系统,尤其适合流式部署场景
大音频语言模型(LALMs)的发展使实时流式语音交互日益可行。在此场景中,推理质量与响应速度紧密耦合:延迟推理可提高答案准确性,但会增加用户可见延迟;过早回答则可能在关键证据到来前仓促作答。本文提出一种可学习的等待-思考-回答控制框架。受人类对话渐进性启发,控制器在部分语音输入下决定何时等待、何时输出紧凑推理更新、何时给出最终回答。以Qwen2.5-Omni-7B为基础,我们从语音推理数据构建对齐的控制轨迹,通过监督微调(SFT)训练控制器,并采用解耦剪辑与动态采样策略优化(DAPO)。奖励函数融合答案正确性、动作有效性、更新时机、延迟同步、推理质量及链路一致性,优化整个控制轨迹而非仅最终答案。在六任务合成语音推理问答(SRQA)基准上,六奖励DAPO控制器将行加权准确率从67.6%提升至70.3%,同时在相同部署条件下将终点后最终思考长度减少14%。在包含186个真人录音的真实音频测试集(超越文本转语音渲染)上,控制器仍有效:SFT表现最佳准确率,而六奖励DAPO是唯一使最终思考长度低于基线的可学习变体。结果表明,流式模型应学会在语音流中适时显式表达中间推理。
原文摘要 · Abstract (English)
Recent advances in Large Audio-Language Models (LALMs) have made real-time, streaming spoken interaction increasingly practical. In this setting, reasoning quality and responsiveness are tightly coupled: delaying reasoning until the speech endpoint can improve answer quality but moves deliberation into user-visible response delay, while answering too early risks committing before decisive evidence arrives. We introduce a learnable wait-think-answer control formulation for LALMs. Motivated by the incremental nature of human conversation, the controller decides under partial audio evidence when to wait, when to externalize a compact reasoning update, and when to answer. Using Qwen2.5-Omni-7B as the base model, we construct aligned wait-think-answer traces from spoken reasoning data, train the controller with supervised fine-tuning (SFT), and then apply Decoupled Clip and Dynamic Sampling Policy Optimization (DAPO). The reward combines answer correctness, action validity, update timing, latency synchronization, reasoning quality, and chain consistency, optimizing the complete wait-think-answer trajectory and not the final answer alone. On a six-task synthetic spoken reasoning question answering (SRQA) benchmark, the six-reward DAPO controller improves the row-weighted accuracy from 67.6% to 70.3% while reducing post-endpoint final-think length by 14% under the same Qwen deployment harness. On a 186-item human-recorded Real Audio Bench, a transfer check beyond text-to-speech (TTS)-rendered speech, the controller family remains functional: SFT achieves the strongest accuracy, while the six-reward DAPO controller is the only learned variant whose final-think length falls below the base. These results suggest that a streaming model should learn when to make intermediate reasoning explicit during the audio stream.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。