揭示大模型过度思考的根源,提出结构化分析方法与新定义。
Do LLMs Really Need 10+ Thoughts for "Find the Time 1000 Days Later"? Towards Structural Understanding of LLM Overthinking
- 构建细粒度分析工具TRACE,拆解模型推理链为最小完整子思考
- 发现两种核心思维模式:探索型与延迟落地型,解释过度推理成因
- 提出基于效用的过度思考新定义,适用于优化推理效率
采用长链式思维(CoT)推理的模型在复杂任务上表现优异,但伴随显著的计算浪费——过度思考现象。即使面对简单问题,模型仍进行冗长推理,导致5至20倍的运行延迟,且准确率无明显提升。本文提出系统性分析框架TRACE,首先将推理过程分解为最小完整子思考单元,再通过推断子思考间的语篇关系,构建细粒度的思维推进图,并识别出主题相似问题的常见思维模式。分析揭示,开放权重模型存在两种主要模式:探索型与延迟落地型,表明过度验证和过度探索是过度思考的主要驱动因素。基于思维结构,提出一种基于效用的过度思考新定义,超越单纯依赖长度的度量,为理解模型推理过程提供更深刻的视角,并给出可操作的管理策略。
原文摘要 · Abstract (English)
Models employing long chain-of-thought (CoT) reasoning have shown superior performance on complex reasoning tasks. Yet, this capability introduces a critical and often overlooked inefficiency -- overthinking -- models often engage in unnecessarily extensive reasoning even for simple queries, incurring significant computations without accuracy improvements. While prior work has explored solutions to mitigate overthinking, a fundamental gap remains in our understanding of its underlying causes. Most existing analyses are limited to superficial, profiling-based observations, failing to delve into LLMs' inner workings. This study introduces a systematic, fine-grained analyzer of LLMs' thought process to bridge the gap, TRACE. We first benchmark the overthinking issue, confirming that long-thinking models are five to twenty times slower on simple tasks with no substantial gains. We then use TRACE to first decompose the thought process into minimally complete sub-thoughts. Next, by inferring discourse relationships among sub-thoughts, we construct granular thought progression graphs and subsequently identify common thinking patterns for topically similar queries. Our analysis reveals two major patterns for open-weight thinking models -- Explorer and Late Landing. This finding provides evidence that over-verification and over-exploration are the primary drivers of overthinking in LLMs. Grounded in thought structures, we propose a utility-based definition of overthinking, which moves beyond length-based metrics. This revised definition offers a more insightful understanding of LLMs' thought progression, as well as practical guidelines for principled overthinking management.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。