arXiv:2607.00485cs.CL2026-07被引 1

用渐进式混语推理,低成本实现多语言逻辑能力迁移

Efficient Multilingual Reasoning Transfer via Progressive Code-Switching

论文配图:Efficient Multilingual Reasoning Transfer via Progressive Code-Switching
图 1 · 摘自论文原文
  • 通过逐步翻译部分英文推理步骤构建混语训练数据
  • 在五种语言上显著缩小与英语推理性能的差距
  • 无需强模型蒸馏或外部评判,适合资源有限场景

大型推理模型(LRMs)在英语中表现出强大的推理能力,但在其他语言中性能明显下降。现有迁移方法通常依赖更强模型的蒸馏目标语言推理轨迹或外部裁判模型的在线监督,成本高且难扩展。本文提出PCS(渐进式混语),仅需轻量级翻译即可完成迁移,无需强模型蒸馏或判别器。PCS首先将部分英文推理步骤翻译为目标语言,构建混语推理轨迹,通过监督微调初始化模型的混语能力;随后采用基于步级语言一致性课程的强化学习,逐步提升目标语言比例,直至模型完全以目标语言推理。该渐进设计提供平滑迁移路径,避免直接强制目标语言推理带来的不稳定性与性能下降。在多个基准和五种语言类型多样的语言上实验表明,PCS显著缩小了目标语言与英语推理间的性能差距,在保持竞争力准确率的同时,生成更符合语言一致性的推理过程。

原文摘要 · Abstract (English)

Large reasoning models (LRMs) have achieved strong reasoning capabilities in English, yet their performance degrades significantly when required to reason in other languages. A natural solution is to transfer the model's English reasoning ability to target languages. However, existing transfer approaches typically rely on distilled target-language reasoning traces from stronger LRMs or online supervision from external judge models, which are costly and difficult to scale. In this paper, we propose PCS (Progressive Code-Switching), a more efficient transfer framework that requires only lightweight translation without any stronger model for distillation or judging. PCS first constructs code-switched reasoning traces by translating a subset of English reasoning steps into the target language, and uses them to initialize the model's code-switching ability via supervised fine-tuning. It then applies reinforcement learning with a step-level language consistency curriculum, progressively raising the target-language ratio until the model reasons entirely in the target language. This progressive design provides a smooth transfer path that avoids the instability and performance degradation commonly observed when directly enforcing target-language reasoning. Experiments on multiple benchmarks and five typologically diverse languages show that PCS substantially narrows the performance gap between target-language and English reasoning, yielding more language-consistent reasoning while maintaining competitive accuracy.

多语言推理代码切换迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。