arXiv:2604.02209cs.CL2026-04中稿 · OSACT 2026

首个阿拉伯语语音命名实体识别数据集,提升端到端模型性能

CV-18 NER: Augmented Common Voice for Named Entity Recognition from Arabic Speech

  • 用Common Voice数据增强并人工标注21类实体,构建首个阿拉伯语语音NER数据集
  • 端到端模型在测试集上达38.0% CVER,显著优于传统流水线方法
  • 适合研究低资源语言语音理解、多语言迁移学习的学者使用

端到端语音命名实体识别(NER)旨在直接从语音中提取实体。已有研究显示,该方法在英语、法语和中文上优于级联流水线,但阿拉伯语因形态复杂、缺少短元音、标注资源匮乏而研究不足。本文提出CV-18 NER,首个公开的阿拉伯语语音NER数据集,基于阿拉伯语Common Voice 18语料库,采用细粒度Wojood标注体系(21类实体)进行人工标注。我们对基于Whisper和AraBEST-RQ的端到端模型及流水线系统进行了基准测试。结果表明,端到端系统在测试集上显著优于最佳流水线配置,达到37.0% CoER(AraBEST-RQ 300M)和38.0% CVER(Whisper-medium)。分析显示,阿拉伯语专用自监督预训练可提升语音识别性能,而多语言弱监督在联合语音到实体学习中迁移效果更优;在低资源环境下,大模型反而更难适配。数据集与模型已开源,提供首个开放的阿拉伯语语音端到端命名实体识别基准。链接:https://huggingface.co/datasets/Elyadata/CV18-NER

原文摘要 · Abstract (English)

End-to-end speech Named Entity Recognition (NER) aims to directly extract entities from speech. Prior work has shown that end-to-end (E2E) approaches can outperform cascaded pipelines for English, French, and Chinese, but Arabic remains under-explored due to its morphological complexity, the absence of short vowels, and limited annotated resources. We introduce CV-18 NER, the first publicly available dataset for NER from Arabic speech, created by augmenting the Arabic Common Voice 18 corpus with manual NER annotations following the fine-grained Wojood schema (21 entity types). We benchmark both pipeline systems (ASR + text NER) and E2E models based on Whisper and AraBEST-RQ. E2E systems substantially outperform the best pipeline configuration on the test set, reaching 37.0% CoER (AraBEST-RQ 300M) and 38.0% CVER (Whisper-medium). Further analysis shows that Arabic-specific self-supervised pretraining yields strong ASR performance, while multilingual weak supervision transfers more effectively to joint speech-to-entity learning, and that larger models may be harder to adapt in this low-resource setting. Our dataset and models are publicly released, providing the first open benchmark for end-to-end named entity recognition from Arabic speech https://huggingface.co/datasets/Elyadata/CV18-NER.

语音识别命名实体阿拉伯语端到端

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。