arXiv:2603.14251cs.CLcs.AI2026-03被引 5

通过监测推理路径偏移,动态终止冗余推理步骤,提升大模型推理效率与准确率。

Mitigating Overthinking in Large Reasoning Language Models via Reasoning Path Deviation Monitoring

  • 利用路径偏移指数监测高熵过渡词元,识别冗余推理轨迹。
  • 在多类模型与基准测试中,相比原版思维链提升性能,优于现有提前退出方法。
  • 无需额外训练,避免频繁内容切换,适合高效部署的复杂任务场景。

大型推理语言模型(LRLMs)通过长链式思维(Chain-of-Thought)在复杂任务上表现优异,但易出现过度推理,生成冗余步骤,降低性能与效率。近期提出的提前退出策略可动态终止冗余推理,但现有方法或需额外训练代理模型,或因频繁在推理与探测输出间切换而限制推理吞吐量,且常因过度截断损害模型性能。本文观察到:过度推理常导致模型偏离正确推理路径,伴随高频高熵过渡词元。为此,提出一种深度耦合原生推理过程的提前退出方法,以路径偏移指数为监控指标,动态检测并终止冗余推理轨迹。在多种类型与规模的LRLMs及多个基准上实验表明,该方法相较原始链式思维,在性能提升幅度上显著优于现有提前退出方法。

原文摘要 · Abstract (English)

Large Reasoning Language Models (LRLMs) demonstrate impressive capabilities on complex tasks by utilizing long Chain-of-Thought reasoning. However, they are prone to overthinking, which generates redundant reasoning steps that degrade both performance and efficiency. Recently, early-exit strategies are proposed to mitigate overthinking by dynamically and adaptively terminating redundant reasoning. However, current early-exit methods either introduce extra training overhead by relying on proxy models or limit inference throughput due to the frequent content switching between reasoning and generating probing answers. Moreover, most early-exit methods harm LRLMs performance due to over-truncation. Our insight stems from an observation: overthinking often causes LRLMs to deviate from the correct reasoning path, which is frequently accompanied by high-entropy transition tokens. Given this, we propose an early-exit method deeply coupled with the native reasoning process, which leverages the path deviation index as a dedicated monitoring metric for the frequent occurrence of high-entropy transition tokens to dynamically detect and terminate overthinking trajectories. We conduct experiments across multiple benchmarks using LRLMs of different types and scales, and the results indicate that our method delivers the largest performance improvement over vanilla CoT compared to existing early-exit methods.

大模型推理思维链提前退出路径监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。