arXiv:2608.07631cs.SDcs.AI2026-08

解决语音对话中用户打断导致的上下文错位问题

PACE: A Playback-Aligned Context Engine for LLM-Based Full-Duplex Voice Dialogue

  • 用播放边界锚定模型上下文,避免用户听到的内容与系统理解不一致
  • 在基准测试中将指代准确率从25.0%提升至96.3%
  • 无需修改模型服务,适配各类语音运行时环境

基于大模型的全双工语音服务允许用户在助手回应时随时说话。由于服务器生成输出和推进对话状态的速度快于客户端播放,后续用户发言可能基于其从未听到的内容被误解。我们称此为生成式上下文错锚(GCM)。为此提出PACE,一种独立于服务提供商的中间层,将模型面向的上下文锚定在客户端播放边界——一个可观察的、反映用户实际听觉范围的系统代理。在中断后,PACE会修复上下文,排除未完成播放的助手内容,同时保持跨异构语音运行时的低延迟生成。我们在浏览器端实时语音助手上端到端实现音频投影路径,使用黑箱语音模型且不修改模型服务。还构建了包含108个播放相对指代锚定案例的GCM-Bench基准数据集。在该数据集上,PACE将指代锚定准确率从25.0%提升至96.3%,优于仅取消方案。在200个Full-Duplex-Bench v1中断样本上,仍保持良好中断响应质量。结果表明,将模型上下文基于实际播放进行锚定是维持全双工语音对话一致性的有效方法。

原文摘要 · Abstract (English)

LLM-based full-duplex voice services allow users to speak while the assistant is responding. Because servers can generate output and advance dialogue state faster than clients can play it, subsequent user speech may be interpreted based on content the user never heard. We call this failure Generative Context Mis-anchoring (GCM). To address GCM issues, we present PACE, a provider-independent middleware layer that anchors model-facing context to the client playback boundary, a system-observable proxy for what the user could have heard. After an interruption, PACE repairs this context to exclude assistant content that never reached playback, while preserving low-latency generation across heterogeneous voice runtimes. We implement PACE's audio-only projection path end to end in a browser-based realtime voice assistant using a black-box speech model, without modifying the model service. We also construct GCM-Bench, a new controlled benchmark dataset of 108 playback-relative referent-anchoring cases. On GCM-Bench, PACE raises Referent Anchoring Accuracy from 25.0% to 96.3% over a cancellation-only baseline. On 200 Full-Duplex-Bench v1 interruption samples, it preserves interruption response quality. These results show that grounding model-facing context in actual playback is a practical way to maintain consistency in full-duplex voice dialogue.

语音对话上下文对齐全双工大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。