arXiv:2603.02246eess.AScs.SD2026-03

对比多种ASR模型在波兰语医疗访谈中的表现,发现Whisper和Scribe表现最优。

Quality of Automatic Speech Recognition -- Polish Language case study -- from Wav2Vec to Scribe ElevenLabs

  • 采用分阶段方案:ASR生成文本后由LLM修正提升准确率。
  • Whisper在开源模型中WER最低,Scribe在波兰语数据上整体最佳。
  • 适用于医疗语音识别场景,尤其关注多噪声环境下的鲁棒性。

本文针对结合大语言模型(LLM)的自动语音识别(ASR)模型在波兰语医疗访谈中的表现进行对比研究。所提方法采用两阶段架构:先用端到端ASR生成初始文本,再通过LLM进行纠错优化。测试涵盖OpenAI Whisper与Scribe ElevenLabs两款先进模型,并与五种主流端到端模型(QuartzNet、FastConformer、Wav2Vec 2.0 XLSR、ESPnet Model Zoo)在Mozilla Common Voice和VoxPopuli数据集上比较。评估条件包括纯净音频、带宽限制及降质音频,使用词错误率(WER)和字符错误率(CER)作为指标。结果表明,Whisper在开源模型中表现最佳,而Scribe ElevenLabs在波兰语通用基准与医疗数据上均取得最高性能。

原文摘要 · Abstract (English)

This article concerns comparative studies on the Automatic Speech Recognition (ASR) model incorporated with the Large Language Model (LLM) used for medical interviews. The proposed solution is tested on polish language benchmarks and dataset with medical interviews. The latest ASR technologies are based on convolutional neural networks (CNNs), recurrent neural networks (RNNs) and Transformers. Most of them work as end-to-end solutions. The presented approach in the case of the Whisper model shows a two-stage solution with End-To-End ASR and LLM working together in a pipeline. The ASR output is an input for LLM. The LLM is a component by which the output from ASR is corrected and improved. Comparative studies for automatic recognition of the Polish language between modern End-To-End deep learning architectures and the ASR hybrid model were performed. The medical interview tests were performed with two state-of-the-art ASR models: OpenAI Whisper incorporated with LLM and Scribe ElevenLabs. Additionally, the results were compared with five more end-to-end models (QuartzNet, FastConformer, Wav2Vec 2.0 XLSR and ESPnet Model Zoo) on Mozilla Common Voice and VoxPopuli databases. Tests were conducted for clean audio signal, signal with bandwidth limitation, and degraded. The tested models were evaluated on the basis of Word Error Rate (WER) and Character Error Rate (CER). The results show that the Whisper model performs by far the best among the open-source models. ElevenLabs Scribe model, on the other hand, performs best for Polish on both general benchmark and medical data.

语音识别LLM融合医疗应用波兰语

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。