arXiv:2605.31378cs.CL2026-05

通过隐式与显式推理互增强,提升低资源语言翻译质量评估精度

Unlocking Fine-Grained Translation Quality Estimation in LRMs through Mutually Boosting Implicit and Explicit Reasoning

  • 分解任务后分两阶段训练:先无思考微调强化隐式推理,再用可验证奖励强化显式推理
  • 在WMT测试集上,显式推理性能超越所有基线模型,隐式推理媲美当前最佳编码器模型
  • 首次实证隐式与显式推理能双向互增强,适合关注推理能力进化的研究者

大型推理模型(LRMs)尽管具备长推理链能力,但在细粒度翻译质量评估(QE)任务上仍表现不佳。我们认为问题核心在于该任务本身的内在复杂性,而非模型能力不足。本文提出RIEQE(Reasoning both Implicitly and Explicitly for QE),一种简单的两阶段训练框架,实现隐式(层间)与显式(词级)推理能力的相互增强。为使隐式推理可行,我们首先将复杂的QE任务拆解为简单子任务。两阶段方法包括:(1) NonThinking-SFT——无需推理链的监督微调,直接提升模型隐式推理倾向与能力;(2) Thinking-RLVR——标准强化学习结合可验证奖励,进一步加强显式推理。在WMT测试集上,基于Qwen3-4B-Thinking-2507的RIEQE在显式推理性能上超越所有基线,其隐式推理能力也达到当前最佳编码器模型水平。我们进一步提供证据,证明隐式与显式推理存在双向互增强关系。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) still struggle with fine-grained translation quality estimation (QE), even with long reasoning chains. We argue that LRMs already possess strong multilingual capabilities, while the core challenge stems from the intrinsic difficulty of learning the fine-grained QE task. In this paper, we propose $\textbf{RIEQE}$ ($\textbf{R}$easoning both $\textbf{I}$mplicitly and $\textbf{E}$xplicitly for $\textbf{QE}$), a simple two-stage training framework that enables the mutually boosting of implicit (layer-wise) and explicit (token-wise) reasoning capabilities. To make implicit reasoning feasible, we first decompose the complex QE task into straightforward subtasks. Based on this, our two-stage approach applies: (1) $\textit{NonThinking-SFT}$, Supervised Fine-Tuning (SFT) without reasoning chains to directly boost the model's implicit reasoning tendency and capability; and (2) $\textit{Thinking-RLVR}$, standard Reinforcement Learning with Verifiable Reward (RLVR) to subsequently strengthen explicit reasoning. On the WMT test sets, RIEQE based on Qwen3-4B-Thinking-2507 surpasses all baselines in explicit reasoning performance, while its implicit reasoning capability is also comparable to the best current encoder-based models. We further provide evidence for the mutually boosting between implicit and explicit reasoning, showing how they benefit each other in a bidirectional manner.

翻译质量评估推理增强两阶段训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。