用检索增强生成提升低资源语音识别准确率,不改模型也能用。
GEC-RAG: Improving Generative Error Correction via Retrieval-Augmented Generation for Automatic Speech Recognition Systems
- 构建查询-真值对知识库,用TF-IDF找相似错误模式。
- 在波斯语上使词错误率显著下降,效果优于直接纠错。
- 无需修改模型,换知识库即可适配新领域,适合云服务场景。
自动语音识别(ASR)系统在多种应用中表现优异,但在低资源语言等特定领域因数据有限和语言特性差异,导致词错误率(WER)升高。本文提出一种基于检索增强生成的生成式纠错方法(GEC-RAG),专为提升低资源领域如波斯语的ASR准确率设计。该方法将ASR系统视为黑盒,采用上下文学习(ICL)框架下的检索增强生成(RAG)机制,通过构建包含ASR预测(1-best与5-best假设)及其对应真实文本的知识库,利用词频-逆文档频率(TF-IDF)度量检索与转录内容语义相似的错误样本。这些检索到的典型错误模式与原始转录一同输入生成式大语言模型(LLM),实现精准修正。实验表明,该方法在波斯语上显著降低词错误率,验证了其在领域自适应与低资源场景中的潜力。本研究强调,仅通过更新知识库即可适配任意新领域,无需修改或微调原始模型,具有高度可扩展性。
原文摘要 · Abstract (English)
Automatic Speech Recognition (ASR) systems have demonstrated remarkable performance across various applications. However, limited data and the unique language features of specific domains, such as low-resource languages, significantly degrade their performance and lead to higher Word Error Rates (WER). In this study, we propose Generative Error Correction via Retrieval-Augmented Generation (GEC-RAG), a novel approach designed to improve ASR accuracy for low-resource domains, like Persian. Our approach treats the ASR system as a black-box, a common practice in cloud-based services, and proposes a Retrieval-Augmented Generation (RAG) approach within the In-Context Learning (ICL) scheme to enhance the quality of ASR predictions. By constructing a knowledge base that pairs ASR predictions (1-best and 5-best hypotheses) with their corresponding ground truths, GEC-RAG retrieves lexically similar examples to the ASR transcription using the Term Frequency-Inverse Document Frequency (TF-IDF) measure. This process provides relevant error patterns of the system alongside the ASR transcription to the Generative Large Language Model (LLM), enabling targeted corrections. Our results demonstrate that this strategy significantly reduces WER in Persian and highlights a potential for domain adaptation and low-resource scenarios. This research underscores the effectiveness of using RAG in enhancing ASR systems without requiring direct model modification or fine-tuning, making it adaptable to any domain by simply updating the transcription knowledge base with domain-specific data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。