让模型根据任务自动选择最合适的语言推理,提升跨文化理解能力。
x1: Learning to Think Adaptively Across Languages and Cultures

- 按实例动态切换语言进行推理,不扩大知识范围只优化语言选择。
- 在数学和文化任务上显著提升准确率,语言选择带来实际性能优势。
- 适合构建全球通用的智能推理系统,尤其关注多语言文化场景。
语言承载不同的抽象方式和归纳先验,但多数大语言模型仅用单一主导语言进行推理。本文提出x1,一类可在实例层面自适应选择优势语言进行推理的模型。x1通过对比同一输入在不同语言中的推理路径进行训练,不扩展模型知识边界,以隔离语言选择的影响。大量实验证明,该方法在多语言数学推理与文化相关任务中均具优势。结果挑战了简单的规模定律:尽管模型规模扩大可缩小数学等程序性任务中的跨语言差异,却无法消除文化相关语言在文化知识召回上的效率与准确性优势。这表明语言选择是推理的核心功能组件,对构建更具普适性与全球适应性的推理模型具有重要意义。
原文摘要 · Abstract (English)
Languages encode distinct abstractions and inductive priors, yet most large language models (LLMs) overlook this diversity by reasoning in a single dominant language. In this work, we introduce x1, a family of reasoning models that can adaptively reason in an advantageous language on a per-instance basis. To isolate the effect of reasoning-language choice, x1 is constructed without expanding the model's knowledge boundaries and is trained by contrasting linguistically distinct reasoning trajectories for the same input. Our extensive experiments demonstrate the benefits of adaptive multilingual reasoning across multilingual mathematical reasoning and culturally grounded tasks. Moreover, our results challenge a simplistic view of scaling laws: while scaling reduces cross-lingual disparities in procedural domains such as math reasoning, it does not eliminate the advantages of culture-associated languages in culturally grounded tasks, as we empirically show that such reasoning enables more efficient and accurate cultural knowledge recall. Overall, our findings establish language choice as a functional component of reasoning, with implications for building more generalist and globally competent reasoning models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。