arXiv:2502.13472cs.CLcs.HC2025-02被引 21

提出可插拔的双工控制模块,提升语音对话系统自然度与准确性。

FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systems

  • 通过模块化设计解耦双工控制,支持独立优化
  • 引入空闲状态,使中断率降24.9%,响应准确率升7.6%
  • 适合需要低延迟、高鲁棒性的实时对话系统研发

全双工语音对话系统显著提升了人机交互的自然性,支持实时双向通信。然而,现有方法因架构高度耦合和简化二元状态建模,面临模块难以独立优化及上下文噪声干扰等问题。本文提出 FlexDuo,一种可插拔的全双工控制模块,通过解耦设计将双工控制与对话系统分离。受人类对话中信息过滤机制启发,引入显式空闲状态(Idle state),既可过滤冗余噪声与无关音频,提升对话质量,又能建立基于语义完整性的缓存机制,降低相互打断风险,保障响应切换精准。在 Fisher 语料库上的实验表明,相比集成式全双工系统基线,FlexDuo 将误打断率降低 24.9%,响应准确率提升 7.6%;同时在中英文对话质量上均优于基于语音活动检测(VAD)的基线系统。所提出的模块化架构与基于状态的对话模型,为构建灵活高效的双工对话系统提供了新路径。

原文摘要 · Abstract (English)

Full-Duplex Speech Dialogue Systems (Full-Duplex SDS) have significantly enhanced the naturalness of human-machine interaction by enabling real-time bidirectional communication. However, existing approaches face challenges such as difficulties in independent module optimization and contextual noise interference due to highly coupled architectural designs and oversimplified binary state modeling. This paper proposes FlexDuo, a flexible full-duplex control module that decouples duplex control from spoken dialogue systems through a plug-and-play architectural design. Furthermore, inspired by human information-filtering mechanisms in conversations, we introduce an explicit Idle state. On one hand, the Idle state filters redundant noise and irrelevant audio to enhance dialogue quality. On the other hand, it establishes a semantic integrity-based buffering mechanism, reducing the risk of mutual interruptions while ensuring accurate response transitions. Experimental results on the Fisher corpus demonstrate that FlexDuo reduces the false interruption rate by 24.9% and improves response accuracy by 7.6% compared to integrated full-duplex dialogue system baselines. It also outperforms voice activity detection (VAD) controlled baseline systems in both Chinese and English dialogue quality. The proposed modular architecture and state-based dialogue model provide a novel technical pathway for building flexible and efficient duplex dialogue systems.

语音对话双工系统模块化设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。