arXiv:2604.19144cs.CL2026-04

让翻译模型先出结果再反思,推理成本降94%仍更准

ReflectMT: Internalizing Reflection for Efficient and High-Quality Machine Translation

论文配图:ReflectMT: Internalizing Reflection for Efficient and High-Quality Machine Translation
图 1 · 摘自论文原文
  • 先翻译后反思,用强化学习内化反思能力
  • 首译质量超多步推理模型,GPT评估高2.16分
  • 适合追求高效高质翻译的部署场景

近年来,大型推理模型(LRMs)在机器翻译(MT)中受到关注。现有方法多采用“先思考再翻译”范式,虽提升翻译质量,但带来高昂推理开销与延迟。为此,我们提出ReflectMT,一种两阶段反思内化算法,采用“先翻译再反思”的新范式。第一阶段通过强化学习培养模型高质量反思与优化能力,增强语义理解与任务知识;第二阶段训练模型将反思所得知识内化。推理时,模型以直接翻译模式运行,无需显式推理步骤即可生成高质量翻译。在WMT24等数据集上的实验表明,其首次翻译结果在自动指标和GPT评估中均优于如DeepSeek-R1等多步推理模型,GPT评估得分提升2.16分,同时减少94.33%的令牌消耗。

原文摘要 · Abstract (English)

Recent years have witnessed growing interest in applying Large Reasoning Models (LRMs) to Machine Translation (MT). Existing approaches predominantly adopt a "think-first-then-translate" paradigm. Although explicit reasoning trajectories significantly enhance translation quality, they incur prohibitive inference costs and latency. To address these limitations, we propose ReflectMT, a two-stage reflection internalization algorithm for machine translation that employs a "translate-first-think-later" paradigm. Our approach develops the model's "translate-reflect-refine" capability through reinforcement learning. In the first stage, we cultivate the model's capacity for high-quality reflection and refinement, thereby enhancing its semantic comprehension and task-specific knowledge. In the second stage, we train the model to internalize the knowledge acquired during reflection. As a result, during inference, ReflectMT operates in a direct translation mode, producing high-quality translations on the first attempt without any explicit reasoning steps. Experimental results on datasets such as WMT24 demonstrate that our model's first-pass translations during inference outperform multi-step reasoning LRMs such as DeepSeek-R1 in both automatic metrics and GPT-based evaluation, achieving a 2.16-point improvement in GPT-based translation quality evaluation while reducing token consumption by 94.33%.

机器翻译推理模型高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。