让大模型同时思考和不思考,通过对比判断是否需要二次推理。
Thinking with Nothinking Calibration: A New In-Context Learning Paradigm in Reasoning Large Language Models
- 模型并行生成思考型与直觉型答案,不一致时触发二次思考。
- 在多个推理任务上超越少样本思维链,对分布外数据提升显著。
- 适合追求高可靠性推理且不想训练模型的研究者使用。
推理类大语言模型(RLLMs)近年来通过结构化多步推理展现出强大能力。尽管先前研究主要集中于训练与推理策略优化,其在上下文学习(ICL)方面的潜力仍待挖掘。为此,我们提出一种新范式——思考与无思考校准(JointThinking),通过单个提示并行引导模型生成两种回答:一种为深度思考模式,另一种为快速直觉模式。当两者不一致时,自动触发第二轮思考。在多个推理基准上的实验表明,JointThinking显著优于少样本思维链(CoT)、两次思考及多数投票方法。其在分布内表现接近基于训练的最先进方法,而在分布外任务上则大幅提升。系统性分析揭示了结构化思考多样性的重要性以及一致性检查的价值。此外,随着模型规模增大,实际与理想推理差距缩小,体现该方法强可扩展性。最后,我们讨论当前局限,并展望未来在RLLMs中更深入的上下文学习研究方向。
原文摘要 · Abstract (English)
Reasoning large language models (RLLMs) have recently demonstrated remarkable capabilities through structured and multi-step reasoning. While prior research has primarily focused on improving their training and inference strategies, their potential for in-context learning (ICL) remains largely underexplored. To fill this gap, we propose Thinking with Nothinking Calibration (JointThinking), a new ICL paradigm that prompts the model to generate two answers in parallel: one in Thinking mode and the other in Nothinking mode. A second round of Thinking is triggered only when the two initial responses are inconsistent, using a single prompt with two different answers. Extensive experiments across multiple reasoning benchmarks demonstrate that JointThinking significantly outperforms few-shot chain-of-thought (CoT), thinking twice and majority voting. Moreover, it achieves comparable in-distribution performance to training-based SOTA reasoning method, while substantially outperforming on out-of-distribution tasks. We further conduct a systematic analysis of the calibration mechanism, showing the importance of structural thinking diversity and the benefits of consistency check. Additionally, we observe that the performance gap between actual and ideal reasoning narrows as model size increases in the second thinking, indicating the strong scalability of our approach. Finally, we discuss current limitations and outline promising directions for future ICL research in RLLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。