arXiv:2609.04653cs.CL2026-09

针对多语言模型推理时翻译程度的权衡,提出自适应调控框架提升低资源语言可靠性。

Choosing the Right Language Mode at Inference Time for Multilingual Reliability

论文配图:Choosing the Right Language Mode at Inference Time for Multilingual Reliability
图 1 · 摘自论文原文
  • 根据校准误差与风险指数动态选择翻译策略,避免冗余信息干扰
  • 在低资源语言上准确率提升25%-37.7%,校准误差降低3-6%
  • 无需训练,适用于主流大模型,特别适合低资源语言场景

多语言大模型在低至中等资源语言上的推理能力较弱。已有研究显示,通过翻译可借助更强的英语表征提升多语言推理表现。然而,翻译量多少合适?何时过多翻译反而引发干扰和过度自信?我们基于LLaMA和Qwen模型,系统测试不同文本范围与语言模式(仅目标语言、仅英语、双语)对准确率与可靠性的影响。结果揭示明确权衡:英语上下文有助于理解并纠正非英语理解错误,但冗余双语上下文会加剧干扰。为此提出可靠性感知自适应推理(RAAI),一种无需训练的测试时框架,包含:(i) 基于期望校准误差(ECE)的路由与提示融合,(ii) 使用中间层风险指数(RI)控制序列推理,仅在可能有效时分配计算,抑制有害的双语冗余。在两个模型族上,RAAI在低资源语言上将准确率提升25%-37.7%,校准误差降低约3-6%,在最低资源语言层级效果最显著。

原文摘要 · Abstract (English)

Multilingual large language models often struggle to reason in low- to mid-resource languages. Prior work has shown that translation can improve multilingual reasoning by helping models access stronger English-centric representations. This raises a central question: How much translation is needed for multilingual large language models to reason reliably, and when does more translation instead trigger interference and overconfidence? Using LLaMA and Qwen models, we run extensive experiments varying text scope and language mode (target-only, English-only, bilingual) to evaluate both accuracy and reliability. Our results reveal a clear trade-off: English context often improve understanding and recover errors caused by non-English comprehension, yet adding redundant bilingual context intensifies interference. We address this trade-off with Reliability-Aware Adaptive Inference (RAAI), a training-free test-time framework that (i) performs Expected Calibration Error (ECE)-aware routing and prompt fusion, and (ii) uses a mid-layer Risk Index (RI) to gate sequential reasoning, allocating compute only when it is likely to help and suppressing harmful bilingual redundancy. Across two model families, RAAI enhances accuracy by 25-37.7% on low-resource languages and lowers calibration error by approximately 3-6%, with the most pronounced benefits in the lowest-resource language tiers.

多语言推理优化可靠性自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。