arXiv:2510.21007cs.CL2025-10被引 1

用置信度自动判断是否需要链式思考,节省计算资源

Can Confidence Estimates Decide When Chain-of-Thought Is Necessary for LLMs?

  • 根据模型置信度决定是否启用链式思考
  • 现有置信度方法可减少约30%的冗余推理
  • 适合希望优化大模型推理效率的研究者

链式思考(CoT)提示是提升大语言模型推理能力的常用方法,但长时间推理常造成不必要的计算开销。本文提出基于置信度的门控CoT机制:模型先给出直接答案和置信度估计,再决定是否调用CoT。我们构建了首个系统性评估框架,对比四种代表性置信度度量方法、随机门控与理想情况下的上界基准。在两种模型族和多个推理任务上的实验表明,现有无训练置信度方法能有效减少冗余推理;但不同置信度指标在不同场景下表现不一。本研究为开发与评估选择性使用CoT的模型提供了实用指导。

原文摘要 · Abstract (English)

Chain-of-thought (CoT) prompting is a common technique for improving the reasoning abilities of large language models (LLMs). However, extended reasoning is often unnecessary and substantially increases token usage. As such, a key question becomes how to optimally allocate compute to when reasoning is actually needed. We study this through confidence-gated CoT, where a model produces a direct answer and a confidence estimate to decide whether to invoke CoT. We present an evaluation framework together with the first systematic study of confidence signals for this decision. We evaluate four representative confidence measures and compare them with random gating and an oracle upper bound. Experiments across two model families and diverse reasoning tasks show that existing training-free confidence measures can reduce redundant reasoning. However, we also find that the utility of individual confidence measures is inconsistent across settings. Through our evaluation framework and analysis, our study provides practical guidance toward developing and evaluating models that selectively use CoT.

大模型推理链式思考置信度效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。