arXiv:2603.21301cs.CLcs.AI2026-03被引 1

通过推理时策略提升大模型逻辑准确性,三类方法各具适用场景。

Enhancing reasoning accuracy in large language models during inference time

  • 采用多轮采样与一致性投票,提升推理结果稳定性。
  • 核采样结合温度控制使准确率提升9%至15%,计算开销小。
  • 双模型验证适合高可靠性需求场景,自省效果有限。

大型语言模型在多步推理任务中虽具强大语言能力,但推理可靠性不足,尤其在无额外训练或微调的情况下。本文系统评估三类推理时技术:(i) 基于随机解码的自一致性,通过控制温度和核采样多次采样,选择最频繁的最终答案;(ii) 双模型推理一致性的验证,对比两个独立模型输出,仅信任一致的推理路径;(iii) 自我反思,由模型自行批判并修正自身推理过程。所有方法均使用Chain-of-Thought(CoT)提示,引导生成中间推理步骤。实验表明,在相同提示与验证设置下,核采样结合可控温度的自一致性方法表现最优,相比贪婪单次解码,准确率绝对提升9%至15%,适用于低风险领域,开销极小。双模型方法提供更多验证,更适配中等风险场景,需额外计算资源。自我反思对小型非推理模型作用甚微,改进有限。

原文摘要 · Abstract (English)

Large Language Models (LLMs) often exhibit strong linguistic abilities while remaining unreliable on multi-step reasoning tasks, particularly when deployed without additional training or fine-tuning. In this work, we study inference-time techniques to improve the reasoning accuracy of LLMs. We systematically evaluate three classes of inference-time strategies: (i) self-consistency via stochastic decoding, where the model is sampled multiple times using controlled temperature and nucleus sampling and the most frequent final answer is selected; (ii) dual-model reasoning agreement, where outputs from two independent models are compared and only consistent reasoning traces are trusted; and (iii) self-reflection, where the model critiques and revises its own reasoning. Across all evaluated methods, we employ Chain-of-Thought (CoT) [1] prompting to elicit explicit intermediate reasoning steps before generating final answers. In this work, we provide a controlled comparative evaluation across three inference-time strategies under identical prompting and verification settings. Our experiments on LLM [2] show that self-consistency with nucleus sampling and controlled temperature value yields the substantial gains, achieving a 9% to 15% absolute improvement in accuracy over greedy single-pass decoding, well-suited for low-risk domains, offering meaningful gains with minimal overhead. The dual-model approach provides additional confirmation for model reasoning steps thus more appropriate for moderate-risk domains, where higher reliability justifies additional compute. Self-reflection offers only marginal improvements, suggesting limited effectiveness for smaller non-reasoning models at inference time.

大模型推理优化自一致性链式思考

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。