arXiv:2510.12195cs.CL2025-10

用偏好优化训练大模型,提升实时翻译的分段精度与质量

DPO-Tuned Large Language Models for Segmentation in Simultaneous Speech Translation

  • 用直接偏好优化微调大语言模型预测分段点
  • 在三语种上提升分段准确率,翻译质量与延迟更优
  • 适合关注实时翻译系统优化的研究者与工程师

实时语音翻译需精准分段以平衡翻译质量与延迟。现有方法如SHAS虽基于预训练模型表现优于启发式规则,但仍受限于监督学习目标,缺乏人类偏好对齐,难以满足自然实时口译需求。本文提出一种基于大语言模型(LLM)并采用直接偏好优化(DPO)训练的分段框架。通过偏好对齐,模型可预测更符合真实场景的分段点。我们在ACL 60/60语料库上评估,覆盖英-日、中-英、德-英三组语言对,以SeamlessM4T v2为翻译主干。实验表明,该方法在分段准确率上超越SHAS,且在翻译质量(BLEU、COMET)与延迟(平均滞后时间)上持续提升。同时,系统与IWSLT基准对比验证了有效性。结果表明,偏好对齐的LLM在自适应、人性化实时翻译中具有显著潜力。

原文摘要 · Abstract (English)

Simultaneous speech translation requires accurate segmentation to balance translation quality and latency. Recent studies such as SHAS have introduced pretrained segmentation models, achieving stronger performance than heuristic rules. However, segmentation models such as SHAS, though pretrained and more robust than heuristic methods, are still constrained by supervised learning objectives and do not incorporate human preference alignment, which is crucial for natural real-time interpretation. In this work, we propose a segmentation framework based on large language models (LLMs) trained with Direct Preference Optimization (DPO). By leveraging preference alignment, our method enables LLMs to predict natural segmentation points that better meet the demands of real-time translation. We evaluate the system on the ACL 60/60 corpus across three language pairs (English-Japanese, Chinese, German), using SeamlessM4T v2 as the translation backbone. Experimental results show that our DPO-tuned LLM achieves higher segmentation accuracy than SHAS and yields consistent improvements in translation quality (BLEU, COMET) as well as latency (Average Lagging). Furthermore, our system benefits from IWSLT baselines for direct comparison. These findings highlight the potential of preference-tuned LLMs to surpass existing pretrained segmentation models and advance adaptive, human-aligned simultaneous interpretation.

语音翻译大模型分段优化偏好学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。