arXiv:2506.18828cs.CL2025-06被引 2

用预训练模型适配流式长语音翻译,兼顾质量与延迟。

MLLP-VRAIN UPV system for the IWSLT 2025 Simultaneous Speech Translation Translation task

  • 分阶段模块化设计,用轻量适配提升预训练模型的实时表现
  • 在ACL60/60上达31.96 BLEU,延迟仅2.94秒
  • 适合缺乏领域数据的团队快速构建低延迟翻译系统

本文介绍MLLP-VRAIN研究组参与IWSLT 2025同步语音翻译任务的方案。针对长时语音实时翻译难题,提出一种模块化级联系统,将Whisper Large-V3-Turbo用于自动语音识别(ASR),NLLB-3.3B用于机器翻译(MT),通过轻量级适配技术而非从零训练端到端模型。采用文档级前缀训练增强MT模型对不完整输入的处理能力,结合等待-k策略与RALCP动态发射策略管理翻译流。配合专用缓冲管理与分段策略,确保长音频序列翻译连贯性。在ACL60/60数据集上的实验显示,系统在翻译质量与延迟间取得良好平衡:BLEU达31.96,非计算感知的StreamLAAL延迟为2.94秒。最终模型在官方测试集(IWSLT25Instruct)上获得29.8 BLEU。结果表明,经精心适配的预训练组件可在无需大量领域平行数据或专用端到端训练的前提下,有效构建长内容同步翻译系统。

原文摘要 · Abstract (English)

This work describes the participation of the MLLP-VRAIN research group in the shared task of the IWSLT 2025 Simultaneous Speech Translation track. Our submission addresses the unique challenges of real-time translation of long-form speech by developing a modular cascade system that adapts strong pre-trained models to streaming scenarios. We combine Whisper Large-V3-Turbo for ASR with the multilingual NLLB-3.3B model for MT, implementing lightweight adaptation techniques rather than training new end-to-end models from scratch. Our approach employs document-level adaptation with prefix training to enhance the MT model's ability to handle incomplete inputs, while incorporating adaptive emission policies including a wait-$k$ strategy and RALCP for managing the translation stream. Specialized buffer management techniques and segmentation strategies ensure coherent translations across long audio sequences. Experimental results on the ACL60/60 dataset demonstrate that our system achieves a favorable balance between translation quality and latency, with a BLEU score of 31.96 and non-computational-aware StreamLAAL latency of 2.94 seconds. Our final model achieves a preliminary score on the official test set (IWSLT25Instruct) of 29.8 BLEU. Our work demonstrates that carefully adapted pre-trained components can create effective simultaneous translation systems for long-form content without requiring extensive in-domain parallel data or specialized end-to-end training.

同步翻译语音识别模型适配低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。