测试不同大模型能否接力完成数学推理,发现跨模型续写仍保持高准确率。
Reasoning Relay: Evaluating Stability and Interchangeability of Large Language Models in Mathematical Reasoning
- 用截断中间推理链,测试不同模型接力续写的能力。
- 跨模型续写时准确率不降反升,逻辑结构也更稳定。
- 适合研究模型协作与可信赖推理的开发者和研究员。
思维链(CoT)提示显著提升了大语言模型的推理能力。以往研究多聚焦于优化模型内部推理策略,但对不同模型间推理过程的可交换性知之甚少。本文探究:一个模型的部分推理链能否被另一模型可靠地继续,无论同族或跨族。通过在基线模型Gemma-3-4B-IT和LLaMA-3.1-70B-Instruct上使用分词级概率阈值,在早期、中期和晚期截断推理链,再由Gemma-3-1B-IT和LLaMA-3.1-8B-Instruct进行续写,评估同族与跨族行为。评估采用过程奖励模型(PRM),构建可复现的推理稳定性评估框架。结果表明,混合推理链常能保持甚至提升最终准确率与逻辑结构。研究揭示了推理可交换性是推理模型的新行为属性,为协同人工智能系统中的模块化可靠推理提供了新范式。
原文摘要 · Abstract (English)
Chain-of-Thought (CoT) prompting has significantly advanced the reasoning capabilities of large language models (LLMs). While prior work focuses on improving model performance through internal reasoning strategies, little is known about the interchangeability of reasoning across different models. In this work, we explore whether a partially completed reasoning chain from one model can be reliably continued by another model, either within the same model family or across families. We achieve this by assessing the sufficiency of intermediate reasoning traces as transferable scaffolds for logical coherence and final answer accuracy. We interpret this interchangeability as a means of examining inference-time trustworthiness, probing whether reasoning remains both coherent and reliable under model substitution. Using token-level log-probability thresholds to truncate reasoning at early, mid, and late stages from our baseline models, Gemma-3-4B-IT and LLaMA-3.1-70B-Instruct, we conduct continuation experiments with Gemma-3-1B-IT and LLaMA-3.1-8B-Instruct to test intra-family and cross-family behaviors. Our evaluation pipeline leverages truncation thresholds with a Process Reward Model (PRM), providing a reproducible framework for assessing reasoning stability via model interchange. Evaluations with a PRM reveal that hybrid reasoning chains often preserve, and in some cases even improve, final accuracy and logical structure. Our findings point towards interchangeability as an emerging behavioral property of reasoning models, offering insights into new paradigms for reliable modular reasoning in collaborative AI systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。