arXiv:2510.13434cs.CL2025-10被引 4

解决机器翻译中模型偏信流畅度的问题,提升译文忠实度。

$M^2PO$: Multi-Perspective Multi-Pair Preference Optimization for Machine Translation

  • 双视角机制分离语义准确性和流畅性,用课程学习优先保证忠实度。
  • 引入多对比较目标,捕捉部分错误的细微差异,提升纠错能力。
  • 在多个数据集上超越开源模型,媲美闭源大模型如GPT-4o。

将大语言模型(LLMs)与人类偏好对齐对机器翻译至关重要,但现有方法常受误导性奖励信号干扰。分析发现,当前质量评估(QE)模型对部分错误(如部分幻觉和遗漏)存在系统性盲区,往往偏好表面流畅但不忠实的翻译。为此,我们提出M²PO(多视角多对偏好优化)框架,聚焦机器翻译中的偏好优化。首先,通过双视角机制解耦语义忠实度与流畅性,并采用课程学习策略优先保障忠实度;其次,纠正偏差后,部分错误介于完美与严重错误之间,标准最优对最差比较难以捕捉。因此,我们设计多对目标,利用完整候选列表提取细粒度错误信号。在WMT23、WMT24和FLORES-200上的实验表明,M²PO使9B模型超越领先开源基线,并达到GPT-4o和Gemini-2.0-Flash等闭源模型水平,展现出高效高保真大模型翻译的巨大潜力。代码与数据集将公开。

原文摘要 · Abstract (English)

Aligning Large Language Models (LLMs) with human preferences is pivotal for Machine Translation (MT), yet current approaches are often hindered by misleading reward signals. Our analysis reveals that prevailing Quality Estimation (QE) models exhibit a systematic blind spot toward partial errors, specifically partial hallucinations and omissions, often favoring superficially fluent but unfaithful translations. To address this issue, we propose $M^2PO$ (Multi-Perspective Multi-Pair Preference Optimization), a data-centric framework for preference optimization in machine translation. First, to correct the bias toward fluency, $M^2PO$ uses a dual-perspective mechanism that decouples semantic fidelity from fluency and prioritizes faithfulness through a curriculum strategy. Second, after correcting this bias, partial errors fall between perfect and severely incorrect translations, making them difficult to learn through standard best-versus-worst comparisons. We therefore introduce a multi-pair objective that leverages the full candidate list to capture these fine-grained error signals. Experiments on WMT23, WMT24, and FLORES-200 show that $M^2PO$ enables a 9B model to outperform leading open-source baselines and achieve parity with proprietary models such as GPT-4o and Gemini-2.0-Flash, demonstrating strong potential for efficient and high-fidelity LLM-based translation. Our code and dataset will be released.

机器翻译偏好优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。