arXiv:2504.19044cs.CL2025-04NeurIPS被引 2

用质量估计校准大模型翻译解码,提升译文质量且无需大量训练。

Calibrating Translation Decoding with Quality Estimation on LLMs

  • 通过优化假设概率与翻译质量的皮尔逊相关性来校准解码
  • 仅用2000条数据微调即显著提升翻译质量,跨多种指标有效
  • 校准后概率可直接作质量预测,媲美顶尖质量评估模型

神经机器翻译系统通常采用最大后验(MAP)解码从分布中选取最高分翻译,但近期研究表明该方法常产生低质量甚至异常的翻译结果——解码目标与真实翻译质量不一致。本文提出从分布视角直接优化假设概率与翻译质量的皮尔逊相关性,以校准解码过程,从而提升翻译有效性。在大型语言模型上,仅需每方向2000个实例的有限训练即可实现显著改进,且该方法与监督微调互补,在多种指标和人工评估中均带来大幅增益,即便应用于已基于高质量数据微调的顶尖翻译专用模型(如Tower),或与近期偏好优化方法(如CPO)对比亦表现优异。此外,校准后的翻译概率可直接作为强质量代理指标,其表现接近甚至超越当前先进翻译质量评估模型(如CometKiwi)。深入分析表明,校准提升了MAP解码的有效性,进而提高实际部署效率。所构建的覆盖10种语言的最先进翻译模型,以及配套代码与人工评估数据,已开源:https://github.com/moore3930/calibrating-llm-mt。

原文摘要 · Abstract (English)

Neural machine translation (NMT) systems typically employ maximum a posteriori (MAP) decoding to select the highest-scoring translation from the distribution mass. However, recent evidence highlights the inadequacy of MAP decoding, often resulting in low-quality or even pathological hypotheses -- the decoding objective is not aligned with real-world translation quality. This paper proposes calibrating hypothesis likelihoods with translation quality from a distribution view by directly optimizing their Pearson correlation -- thereby enhancing the effectiveness of translation decoding. With our method, translation on large language models (LLMs) improves substantially after limited training (2K instances per direction). This improvement is orthogonal to those achieved through supervised fine-tuning, leading to substantial gains across a broad range of metrics and human evaluations -- even when applied to top-performing translation-specialized LLMs fine-tuned on high-quality translation data, such as Tower, or when compared to recent preference optimization methods, like CPO. Moreover, the calibrated translation likelihood can directly serve as a strong proxy for translation quality, closely approximating or even surpassing some state-of-the-art translation quality estimation models, like CometKiwi. Lastly, our in-depth analysis demonstrates that calibration enhances the effectiveness of MAP decoding, thereby enabling greater efficiency in real-world deployment. The resulting state-of-the-art translation model, which covers 10 languages, along with the accompanying code and human evaluation data, has been released to the community: https://github.com/moore3930/calibrating-llm-mt.

机器翻译大模型质量估计解码优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。