arXiv:2604.17304cs.AI2026-04ACL被引 2

通过时间聚合判断推理收敛,减少大模型冗余思考

Efficient Test-Time Scaling via Temporal Reasoning Aggregation

论文配图:Efficient Test-Time Scaling via Temporal Reasoning Aggregation
图 1 · 摘自论文原文
  • 用多步证据的时间聚合代替单步置信度判断
  • 平均减少25%-30%推理令牌消耗,准确率仅降1%-2%
  • 无需训练,适合所有需高效推理的场景

测试时扩展能提升大语言模型的推理性能,但常导致令牌低效的过度思考,即模型在得出正确答案后仍继续推理。现有动态早退方法通常依赖单步置信度信号,在多步推理中不可靠。为此,我们提出TRACE——一种无需训练的高效测试时扩展框架,通过时间聚合多步证据来决定何时终止推理,而非依赖瞬时信号。TRACE通过聚合两个互补信号:答案一致性(预测答案的持续性)和置信度轨迹(模型置信度的时序演化),检测推理是否收敛。得益于这两项因素,TRACE可准确判断推理是否完成,及时终止推理,有效避免冗余步骤。在多个挑战性基准上的实验表明,与完整推理相比,TRACE平均减少25%-30%的推理令牌使用量,准确率仅下降1%-2%,且始终优于现有动态推理方法。

原文摘要 · Abstract (English)

Test-time scaling improves the reasoning performance of large language models but often results in token-inefficient overthinking, where models continue reasoning beyond what is necessary for a correct answer. Existing dynamic early-exit methods typically rely on single-step confidence signals, which are often unreliable for detecting reasoning convergence in multi-step settings. To mitigate this limitation, we propose TRACE, a training-free framework for efficient test-time scaling that determines when to terminate reasoning based on temporal aggregation of multi-step evidence rather than instantaneous signals. TRACE detects reasoning convergence over time by aggregating two complementary signals across recent reasoning steps: answer consistency, capturing the persistence of predicted answers, and confidence trajectory, modeling the temporal evolution of model confidence. Benefiting from these two factors, TRACE can accurately determine whether the reasoning process has converged, thereby promptly halting inference and effectively avoiding redundant reasoning steps. Extensive experiments on multiple challenging benchmarks show that TRACE reduces reasoning token usage by 25-30% on average while maintaining accuracy within 1-2% of full-length reasoning, consistently outperforming existing dynamic reasoning methods.

推理优化测试时扩展早退机制大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。