arXiv:2606.02465cs.CLcs.AI2026-06被引 1

让大模型学会在该翻译时才翻译,提升多语言推理能力

Learning When to Translate for Multilingual Reasoning

论文配图:Learning When to Translate for Multilingual Reasoning
图 1 · 摘自论文原文
  • 用强化学习训练模型判断何时该翻译,何时可直接理解
  • 在低资源语言上性能提升显著,比标准方法高12.3%以上
  • 能自动识别无需翻译的情况,且泛化到未见过的语言

推理语言模型(RLMs)在复杂推理任务中表现优异,但在非英语输入上仍存在显著的多语言推理差距,主要源于语言理解失败。英语翻译可缓解此类问题,将非英语输入转化为模型更可靠的解读形式,但并非所有输入都需翻译。为此,我们提出Luar——一种语言理解边界感知的强化学习框架,训练RLM在直接求解原始输入与基于英文翻译推理之间进行选择,仅当翻译后推理预期显著优于直接推理时才调用翻译。在多个多语言推理基准测试中,Luar优于标准GRPO及其他基于训练的基线方法,尤其在低资源语言上表现突出。进一步分析表明,Luar能避免在直接推理已足够时的冗余翻译,并将翻译调用行为泛化至未见的低资源语言。结果表明,模型可自主学习在理解不可靠时才调用翻译,实现更高效的多语言推理。

原文摘要 · Abstract (English)

Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, but still exhibit substantial multilingual reasoning gaps, largely due to language-understanding failures in non-English inputs. English translation can mitigate these failures by expressing non-English inputs in a form that RLMs can more reliably interpret, yet translating every input is unnecessary when the model can reason reliably from the original query. To address this challenge, we propose Luar, a Language Understanding Boundary-aware Reinforcement Learning framework that trains RLMs to selectively invoke translation when direct understanding is unreliable. Luar trains the model to choose between solving the original input directly and reasoning over its English translation, encouraging translation only when translator-augmented reasoning is expected to substantially outperform direct reasoning. Across multilingual reasoning benchmarks, Luar outperforms standard GRPO and other training-based baselines, with particularly large gains on low-resource languages. Further analysis shows that Luar avoids unnecessary translation in cases where direct reasoning is sufficient, while extending its translator-call behavior to unseen low-resource languages. Together, our work suggests a selective approach to multilingual reasoning: RLMs can learn to invoke translation only when their direct understanding is unreliable. The project will be made publicly available at https://github.com/deokhk/LUAR

多语言推理强化学习智能决策低资源语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。