提升单字语音识别在嘈杂环境下的准确率,适合医疗应急等关键场景。
SW-ASR: A Context-Aware Hybrid ASR Pipeline for Robust Single Word Speech Recognition
- 融合降噪、归一化与混合语音识别前端,增强鲁棒性。
- 验证层在噪声和压缩音频下显著提升识别准确率,最高增益来自上下文引导匹配。
- 轻量级设计适配实时通话需求,兼顾精度与延迟。
单字语音识别因缺乏语言上下文,易受噪声、发音差异和信道失真影响,尤其在医疗、应急等低资源、高重要性领域挑战巨大。本文回顾近期深度学习方法,提出一种模块化框架以实现鲁棒的单字语音检测。系统结合降噪与归一化处理,采用混合前端(Whisper + Vosk)并引入验证层,用于应对未登录词与退化音频。验证层支持多种匹配策略:嵌入相似度、编辑距离及基于大语言模型的匹配(可选上下文引导)。在Google Speech Commands数据集和从电话及消息平台采集的带宽受限真实数据集上评估显示,尽管混合前端在干净音频上表现良好,但验证层在噪声与压缩信道中显著提升准确率;其中上下文引导与大语言模型匹配带来最大增益,证明轻量级验证机制与上下文信息可显著提升单字语音识别鲁棒性,且不牺牲实时通信所需的低延迟特性。
原文摘要 · Abstract (English)
Single-word Automatic Speech Recognition (ASR) is a challenging task due to the lack of linguistic context and sensitivity to noise, pronunciation variation, and channel artifacts, especially in low-resource, communication-critical domains such as healthcare and emergency response. This paper reviews recent deep learning approaches and proposes a modular framework for robust single-word detection. The system combines denoising and normalization with a hybrid ASR front end (Whisper + Vosk) and a verification layer designed to handle out-of-vocabulary words and degraded audio. The verification layer supports multiple matching strategies, including embedding similarity, edit distance, and LLM-based matching with optional contextual guidance. We evaluate the framework on the Google Speech Commands dataset and a curated real-world dataset collected from telephony and messaging platforms under bandwidth-limited conditions. Results show that while the hybrid ASR front end performs well on clean audio, the verification layer significantly improves accuracy on noisy and compressed channels. Context-guided and LLM-based matching yield the largest gains, demonstrating that lightweight verification and context mechanisms can substantially improve single-word ASR robustness without sacrificing latency required for real-time telephony applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。