用音似图+语言模型修正语音识别的关键词错误
Graph-Based Phonetic Error Correction of Noisy ASR

- 构建音似词图,只在发音相近词中找候选
- 结合上下文评分,纠正关键词错误率降17.3%
- 轻量模块化设计,适合实时纠错场景
自动语音识别(ASR)系统虽整体词错误率低,但残留的词汇错误常集中在命名实体、否定词和情感词等语义关键词上。这些错误具有结构特征,源于发音相似性而非随机噪声,因此单纯基于词级别的纠正方法效果有限。本文提出G-SPIN框架,结合音似图建模与上下文语言理解:首先用图神经网络(GNN)为标记词构建声学上合理的候选邻域,将纠错搜索空间限制在发音相近的选项内;接着用掩码语言模型(MLM)进行局部上下文打分;最后由指令微调的大语言模型(LLM)对精简候选集进行上下文感知重排序。该方法将结构化发音推理与上下文语义选择解耦,在避免无约束生成的同时提升纠正准确率。框架轻量、模块化,完全在推理时运行。
原文摘要 · Abstract (English)
Automatic speech recognition (ASR) systems, despite low overall word error rates, produce residual lexical errors that disproportionately affect semantically critical tokens such as named entities, negations, and sentiment-bearing words. These errors are often structured, arising from phonetic similarity rather than random noise, making naive token-level correction insufficient. We propose a structured ASR correction framework, that we call G-SPIN, that combines phonetic graph modeling with contextual language understanding. A graph neural network (GNN) first constructs acoustically plausible candidate neighborhoods for flagged tokens, explicitly restricting the correction search space to phonetic alternatives. A masked language model (MLM) then provides local contextual scoring, and an instruction-tuned large language model (LLM) performs final context-aware re-ranking over this compact candidate set. By decoupling structured phonetic reasoning from contextual semantic selection, our method avoids unconstrained generation while improving correction accuracy. The framework is lightweight, modular, and operates entirely at inference time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。