提出新指标与模型,让语音对话系统更准更快地识别用户打断。
Semantic-Aware Interruption Detection in Spoken Dialogue Systems: Benchmark, Metric, and Model
- 用大语言模型捕捉语义线索,提升打断识别精度
- 引入新指标APT,使响应速度与稳定性可量化权衡
- 基于真实对话构建首个语义感知打断基准数据集
实现自然的全双工语音对话仍面临挑战,主要源于用户打断检测不准。现有方法或过于敏感导致误判,或响应延迟严重。本文提出完整框架:首先构建首个基于真实人类对话的语义感知打断检测基准SID-Bench;提出平均惩罚时间(APT)指标,对误报和延迟均赋予时间代价;设计基于大语言模型的检测模型,通过新颖训练范式优化语义理解能力。实验表明,该模型显著优于主流基线,APT降低近三倍。本工作解决了响应速度与鲁棒性长期矛盾,建立了语音对话系统智能打断处理的新标准。相关数据与代码已开源:https://github.com/xkx-hub/SID-bench。
原文摘要 · Abstract (English)
Achieving natural full-duplex interaction in spoken dialogue systems (SDS) remains a challenge due to the difficulty of accurately detecting user interruptions. Current solutions are polarized between "trigger-happy" VAD-based methods that misinterpret backchannels and robust end-to-end models that exhibit unacceptable response delays. Moreover, the absence of real-world benchmarks and holistic metrics hinders progress in the field. This paper presents a comprehensive frame-work to overcome these limitations. We first introduce SID-Bench, the first benchmark for semantic-aware interruption detection built entirely from real-world human dialogues. To provide a rigorous assessment of the responsiveness-robustness trade-off, we propose the Average Penalty Time (APT) metric, which assigns a temporal cost to both false alarms and late responses. Building on this framework, we design an LLM-based detection model optimized through a novel training paradigm to capture subtle semantic cues of intent. Experimental results show that our model significantly outperforms mainstream baselines, achieving a nearly threefold reduction in APT. By successfully resolving the long-standing tension between speed and stability, our work establishes a new state-of-the-art for intelligent interruption handling in SDS. To facilitate future research, SID-Bench and the associated code are available at: https://github.com/xkx-hub/SID-bench.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。