提出两种新算法,让语音识别更快更准
IKFST: IOO and KOO Algorithms for Accelerated and Precise WFST-based End-to-End Automatic Speech Recognition
- 区分空白帧和非空白帧的作用,分别设计优化策略
- 在多个数据集上实现更高准确率,推理延迟显著降低
- 适合需要高效高精度语音识别的工业场景
端到端语音识别已成为学术界与工业界的主流范式。为提升识别性能,加权有限状态转换器(WFST)通过静态图组合集成声学模型与语言模型,提供稳健解码与有效纠错能力。然而,WFST 解码依赖于基于 CTC 后验概率的逐帧自回归搜索,严重限制了推理效率。本文系统研究了 CTC 输出的两个核心组成部分——空白帧与非空白帧,并发现关键洞察:空白帧主要编码位置信息,非空白帧承载语义内容。基于此,提出 Keep-Only-One 与 Insert-Only-One 两种解码算法,显式利用空白帧与非空白帧的结构角色,在不牺牲识别准确率的前提下显著加速 WFST 解码。在大规模内部数据集、AISHELL-1 和 LibriSpeech 上的实验表明,该方法实现了业界领先识别准确率,同时大幅降低解码延迟,使现代语音识别系统具备真正高效的高精度解码能力。
原文摘要 · Abstract (English)
End-to-end automatic speech recognition has become the dominant paradigm in both academia and industry. To enhance recognition performance, the Weighted Finite-State Transducer (WFST) is widely adopted to integrate acoustic and language models through static graph composition, providing robust decoding and effective error correction. However, WFST decoding relies on a frame-by-frame autoregressive search over CTC posterior probabilities, which severely limits inference efficiency. Motivated by establishing a more principled compatibility between WFST decoding and CTC modeling, we systematically study the two fundamental components of CTC outputs, namely blank and non-blank frames, and identify a key insight: blank frames primarily encode positional information, while non-blank frames carry semantic content. Building on this observation, we introduce Keep-Only-One and Insert-Only-One, two decoding algorithms that explicitly exploit the structural roles of blank and non-blank frames to achieve significantly faster WFST-based inference without compromising recognition accuracy. Experiments on large-scale in-house, AISHELL-1, and LibriSpeech datasets demonstrate state-of-the-art recognition accuracy with substantially reduced decoding latency, enabling truly efficient and high-performance WFST decoding in modern speech recognition systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。