arXiv:2502.01182cs.CLcs.AI2025-02中稿 · LREC 2026

用单一模型通过中间语言生成多样译文,提升低资源翻译质量

A Single Model Ensemble Framework for Neural Machine Translation using Pivot Translation

  • 仅用一个模型,通过中间语言生成多样化候选译文
  • 在多个低资源语言对上实现比单模型更高的翻译准确率
  • 适合资源匮乏语言对的实用翻译系统优化

尽管神经机器翻译近期取得显著进展,低资源语言对的翻译质量仍不理想。集成多个系统是常用提升性能的方法,通常通过合并概率分布实现,但传统方法需训练多模型,计算成本高;且对黑盒模型而言,在解码每一步平均词级概率不可行。为此,我们提出一种基于中间语言的单模型集成框架,包含两步:基于中间语言的候选生成与事后聚合。第一步通过中间语言生成候选译文,仅需一个模型即可实现,促进高资源语言知识迁移,生成的候选译文既多样又准确。第二步从生成候选中选出k个高质量译文进行融合,生成最终翻译结果。实验表明,该方法利用中间语言候选捕捉源句细微语义,显著提升翻译质量。

原文摘要 · Abstract (English)

Despite the recent remarkable advances in neural machine translation, translation quality for low-resource language pairs remains subpar. Ensembling multiple systems is a widely adopted technique to enhance performance, often accomplished by combining probability distributions. However, previous approaches face the challenge of high computational costs for training multiple models. Furthermore, for black-box models, averaging token-level probabilities at each decoding step is not feasible. To address the problems of multi-model ensemble methods, we present a pivot-based single model ensemble. The proposed strategy consists of two steps: pivot-based candidate generation and post-hoc aggregation. In the first step, we generate candidates through pivot translation. This can be achieved with only a single model and facilitates knowledge transfer from high-resource pivot languages, resulting in candidates that are not only diverse but also more accurate. Next, in the aggregation step, we select k high-quality candidates from the generated candidates and merge them to generate a final translation that outperforms the existing candidates. Our experimental results show that our method produces translations of superior quality by leveraging candidates from pivot translation to capture the subtle nuances of the source sentence.

机器翻译低资源集成学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。