发现多语言推理差距源于理解失败,通过选择性翻译有效缩小差距。
Why Do Multilingual Reasoning Gaps Emerge in Reasoning Language Models?
- 识别语言理解失败,仅在必要时添加英文翻译
- 仅翻译20%输入即实现接近全翻译性能
- 为公平多语言推理提供可检测、可缓解的新路径
推理语言模型(RLMs)在复杂任务上表现优异,但在低资源语言上仍存在显著的多语言推理差距。本文揭示该差距主要源于语言理解失败——模型无法将多语言输入正确转化为其推理主导语言(通常是英语)。我们评估多种检测方法,发现监督式方法能有效识别理解失败。基于此,提出选择性翻译策略:仅在检测到理解失败时,才在初始推理链中加入英文翻译。在Qwen3-4B上的实验表明,该策略仅需翻译约20%的输入,即可实现接近全翻译的性能,显著缩小多语言推理差距。结果说明语言理解失败是核心原因,且可被检测与选择性缓解,为构建更公平的多语言推理系统提供了新思路。代码与数据已开源。
原文摘要 · Abstract (English)
Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, yet they still exhibit a multilingual reasoning gap, performing better in high-resource languages than in low-resource ones. While recent efforts have been made to address this gap, its underlying causes remain largely unexplored. In this work, we show that this gap primarily stems from failures in language understanding-specifically, the model's inability to translate multilingual inputs into the language dominating its reasoning traces (typically English). As identifying understanding failures can enable targeted mitigation of the gap, we evaluate a range of detection methods and find that understanding failures are detectable to a meaningful extent, with supervised approaches performing best. Building on this, we propose Selective Translation, a strategy that incorporates an English translation into the initial reasoning trace only when an understanding failure is detected. Experimental results using Qwen3-4B show that Selective Translation substantially bridges the multilingual reasoning gap, achieving near full-translation performance while translating only about 20% of inputs. Together, our results show that failures in language understanding are the primary driver of the multilingual reasoning gap and can be detected and selectively mitigated, clarifying its origin and suggesting a path toward more equitable multilingual reasoning. Our code and data are publicly available at https://github.com/deokhk/RLM_analysis
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。