arXiv:2604.20090cs.CL2026-04ACL

通过精简语言与推理路径,提升多语言逻辑推理效率。

Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Framework

论文配图:Less Languages, Less Tokens: An Efficient Unified Logic Cross-lingual Chain-of-Thought Reasoning Framework
图 1 · 摘自论文原文
  • 在统一逻辑空间中选择少数候选语言,减少语言冗余。
  • 动态监控推理轨迹,剪枝低质量路径,节省超50%解码token。
  • 适合资源有限场景,尤其提升低资源语言表现。

跨语言链式思维(XCoT)结合自一致机制显著增强多语言推理能力,但现有方法因需在多语言中大量采样完整推理路径而成本高昂。此外,不同语言的大型语言模型表示差异大,阻碍直接特征比较与有效剪枝。为此,我们提出UL-XCoT,首个高效统一逻辑跨语言推理框架,在推理采样预算有限时实现最高效率。具体而言,UL-XCoT(1)通过在语言无关的统一逻辑空间中为每条查询选择少量候选语言,减少语言数量;(2)在解码过程中监测逻辑空间轨迹动态,剪枝低质量推理路径,降低token消耗;(3)通过投票聚合剩余高质量路径。在18种语言的PolyMath和29种语言的MMLU-ProX-Lite数据集上,使用DeepSeek-R1-DistillQwen-7B模型的实验表明,UL-XCoT在保持竞争力准确率的同时,解码token成本相较以往采样基线削减超过50%。该方法在低资源语言上也展现出更稳定的提升,证明其鲁棒性优于标准XCoT自一致方法。

原文摘要 · Abstract (English)

Cross-lingual chain-of-thought (XCoT) with self-consistency markedly enhances multilingual reasoning, yet existing methods remain costly due to extensive sampling of full trajectories across languages. Moreover, multilingual LLM representations vary strongly by language, hindering direct feature comparisons and effective pruning. Motivated by this, we introduce UL-XCoT, the first efficient unified logic cross-lingual reasoning framework that minimizes redundancy in token usage and latency, yielding the greatest efficiency under limited sampling budgets during inference. Specifically, UL-XCoT (1) achieves less languages by selecting, per query, a small candidate language set in a language-invariant unified logic space, (2) enables less tokens by monitoring logic-space trajectory dynamics during decoding to prune low-quality reasoning paths, and (3) aggregates the remaining high-quality trajectories via voting. Experiments on PolyMath across 18 languages and MMLU-ProX-Lite across 29 languages with DeepSeek-R1-DistillQwen-7B demonstrate that UL-XCoT achieves competitive accuracy while sharply cutting over 50% decoding token cost versus prior sampling baselines. UL-XCoT also delivers more stable gains on low-resource languages, underscoring consistently superior robustness where standard XCoT self-consistency method fails.

多语言推理链式思维高效生成逻辑空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。