arXiv:2510.12827eess.AScs.AI2025-10被引 6

梳理近十年语音识别从传统模型到端到端神经网络的演进路径。

Automatic Speech Recognition in the Modern Era: Architectures, Training, and Evaluation

  • 对比GMM-HMM、DNN-HMM到CTC、RNN-T、Transformer等主流架构
  • 揭示自监督学习使标注数据依赖大幅降低,如wav2vec 2.0和Whisper
  • 适合语音识别研究者与系统开发者参考,涵盖训练、评估与部署要点

自动语音识别(ASR)在过去十年中因深度学习发展而经历深刻变革。本文综述了现代ASR的演进历程,从传统的混合系统(如GMM-HMM和DNN-HMM)转向如今主导的端到端神经架构。系统回顾了基础端到端范式:连接时序分类(CTC)、基于注意力的编码器-解码器模型以及循环神经网络转换器(RNN-T),为完全集成的语音转文本系统奠定基础。随后,架构向Transformer和Conformer模型演进,利用自注意力机制高效捕捉长距离依赖。本文的核心主题是训练范式的同步革命:从全监督学习结合SpecAugment等技术,转向以wav2vec 2.0为代表的基础自监督学习模型,显著降低对标注数据的依赖。此外,还分析了大规模弱监督模型Whisper带来的鲁棒性提升。文章涵盖关键数据集与基准(如LibriSpeech、Switchboard、CHiME)、标准评估指标(如字错误率)、实时推理、设备端效率及公平性与鲁棒性的伦理考量。最后指出开放挑战与未来方向。

原文摘要 · Abstract (English)

Automatic Speech Recognition (ASR) has undergone a profound transformation over the past decade, driven by advances in deep learning. This survey provides a comprehensive overview of the modern era of ASR, charting its evolution from traditional hybrid systems, such as Gaussian Mixture Model-Hidden Markov Models (GMM-HMMs) and Deep Neural Network-HMMs (DNN-HMMs), to the now-dominant end-to-end neural architectures. We systematically review the foundational end-to-end paradigms: Connectionist Temporal Classification (CTC), attention-based encoder-decoder models, and the Recurrent Neural Network Transducer (RNN-T), which established the groundwork for fully integrated speech-to-text systems. We then detail the subsequent architectural shift towards Transformer and Conformer models, which leverage self-attention to capture long-range dependencies with high computational efficiency. A central theme of this survey is the parallel revolution in training paradigms. We examine the progression from fully supervised learning, augmented by techniques like SpecAugment, to the rise of self-supervised learning (SSL) with foundation models such as wav2vec 2.0, which drastically reduce the reliance on transcribed data. Furthermore, we analyze the impact of largescale, weakly supervised models like Whisper, which achieve unprecedented robustness through massive data diversity. The paper also covers essential ecosystem components, including key datasets and benchmarks (e.g., LibriSpeech, Switchboard, CHiME), standard evaluation metrics (e.g., Word Error Rate), and critical considerations for real-world deployment, such as streaming inference, on-device efficiency, and the ethical imperatives of fairness and robustness. We conclude by outlining open challenges and future research directions.

语音识别自监督学习Transformer模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。