用拼音和字形联合过滤,提升中文语音识别关键词准确率
JSPG: Dynamic Dictionary Filtering via Joint Semantic-Pinyin-Glyph Retrieval for Chinese Contextual ASR

- 融合语义、拼音、字形三特征动态筛选关键词
- 在Aishell-1和RWCS-NER上显著降低错误率
- 适合需要高精度关键词识别的中文语音系统
上下文自动语音识别(ASR)在使用大规模关键词词典时,因大量无关候选词引入噪声而影响准确性。传统动态过滤依赖基础模型生成初步假说,再通过语义检索获取相关关键词,但在中文场景下常失效。因基础模型常产生同音或近音错误,虽保留发音线索但严重扭曲语义,导致语义检索无效。为此,我们提出联合语义-拼音-字形检索框架(JSPG)。拼音基于发音相似性精准召回目标词,字形提供结构信息以剔除大量同音异形词。为衔接字符级拼音/字形度量与序列级过滤,引入扩展的Smith-Waterman算法,计算候选序列与关键词间的相似度得分。在Aishell-1与RWCS-NER数据集上的实验表明,JSPG显著优于单一特征基线。且经JSPG引导的下游上下文ASR模型,在关键词识别准确率上获得显著提升。
原文摘要 · Abstract (English)
Contextual Automatic Speech Recognition (ASR) faces challenges with large-scale keyword dictionaries, as excessive irrelevant candidates introduce noise that degrades accuracy. To address this, dynamic filtering typically uses a base ASR model to generate preliminary hypotheses, followed by semantic text retrievers to fetch a concise subset of relevant keywords. However, this approach frequently fails in Chinese ASR. Base models often produce homophonic or near-homophonic errors that preserve the phonetic cues of the target keywords but severely distort their semantic meaning, rendering standard semantic retrievers ineffective. To resolve this, we propose a filtering framework that jointly integrates Semantic, Pinyin, and Glyph features (JSPG). Pinyin effectively retrieves targets based on phonetic similarity, while glyph provides complementary structural cues to filter out numerous irrelevant homophones inherent in Chinese. To bridge the gap between character-level pinyin/glyph metrics and sequence-level filtering, we introduce an extended Smith-Waterman algorithm that computes similarity scores between the N-best hypothesis sequences and keywords. Experiments on the Aishell-1 and RWCS-NER datasets demonstrate that JSPG significantly outperforms single-feature baselines. Furthermore, downstream contextual ASR models guided by JSPG achieve substantial improvements in keyword recognition accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。