arXiv:2603.22016cs.LGcs.AI2026-03

让大模型在找到正确答案后立即停止冗余思考,提升效率与准确性。

ROM: Real-time Overthinking Mitigation via Streaming Detection and Intervention

  • 通过监测隐藏状态识别思维转折点,实时干预停止无效推理。
  • 平均缩短响应长度45%,在25组实验中19次达到最高准确率。
  • 无需修改模型、不需额外解码,可跨模型和任务零样本迁移。

大型推理模型(LRMs)常在链式思维的早期就得出正确答案,却仍继续冗余验证、重复尝试或无意义探索,浪费计算资源甚至推翻正确结果。我们将其行为视为从高效推理向冗余思考的潜在转变,并发现该变化直接体现在隐藏状态中:在首次正确答案(FCS)边界附近,深层表示能区分有效与过犹不及的思维片段,而边界置换和位置控制则失效。为此提出ROM框架,通过轻量级隐藏状态检测器(约骨干参数的0.1%)持续监控冻结的LRM,在合理推理边界进行干预;反事实自我修正(CSC)平衡错误→正确路径的监督,保留前FCS阶段的有益自修正能力。不同于以往自适应早停方法,ROM不提取中间答案,不发起探测解码,也不更新主干权重。在三个模型家族的五种骨干网络和五个推理基准上,相比十个近期基线,在统一协议下,ROM$_{\text{CSC}}$在25个组合中有19个达到最高准确率,响应长度减少28–77%(均值45%),且在所有设置中唯一位于准确率-长度帕累托前沿。同一MATH500训练的监督信号可零样本跨规模、跨家族、跨任务域迁移,端到端时延降低46.5%,每词仅增加约5%开销。代码已公开于https://github.com/SaFo-Lab/ROM。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) often reach a correct solution before their long Chain-of-Thought trace ends, yet continue with redundant verification, repeated attempts, or unnecessary exploration that wastes computation and can even overturn the correct answer. We frame this behavior as a latent productive-to-redundant transition and show it is directly reflected in hidden states: around first-correct-solution (FCS) boundaries, late-layer representations separate efficient from overthinking tokens, while boundary-permutation and position controls collapse. We propose ROM, a streaming intervention framework that monitors a frozen LRM with a lightweight hidden-state detector ($\sim$0.1\% of backbone parameters) and intervenes at well-formed reasoning boundaries; Counterfactual Self-Correction (CSC) balances supervision with wrong$\rightarrow$correct trajectories, preserving useful pre-FCS self-correction. Unlike prior adaptive early-exit methods, ROM extracts no intermediate answers, launches no probe decoding, and updates no backbone weights. Across five backbones from three model families and five reasoning benchmarks, against ten recent baselines under a shared protocol, ROM$_{\text{CSC}}$ attains the highest accuracy in 19 of 25 model--benchmark settings, cuts response length by 28--77\% (mean 45\%) versus vanilla decoding, and is the only method on the accuracy--length Pareto front in every setting. The same MATH500-trained supervision transfers zero-shot across scales, families, and task domains, and end-to-end wall-clock latency drops by 46.5\% with $\sim$5\% per-token overhead. Code is available at https://github.com/SaFo-Lab/ROM.

推理优化大模型效率提升早停机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。