arXiv:2608.16425cs.AI2026-08

通过时间置信度动态管理并行推理,显著降低计算开销。

ParaTempo: Efficient Parallel Reasoning via Temporal Confidence

论文配图:ParaTempo: Efficient Parallel Reasoning via Temporal Confidence
图 1 · 摘自论文原文
  • 用时间置信度衡量各分支答案收敛程度,实现异步控制。
  • 在数学与科学推理任务中降低21.8%-32.2%延迟和18.1%-30.3%令牌用量。
  • 无需同步轨迹,适合高并发、低延迟场景的推理优化。

并行推理通过探索多条解题路径提升大模型的准确率与鲁棒性,但其计算成本随推理深度和分支数量增加而上升。现有方法依赖最终答案共识、局部词元置信度或孤立的中间探测信号,但这些信号常存在延迟、与实际推理进度关联弱或噪声过大,难以实现分支级动态控制。为此,我们提出ParaTempo,一种无需训练的异步并行推理框架。ParaTempo基于时间置信度——一个反映答案空间收敛程度的分支本地度量。每个分支定期探测候选答案的概率分布,时间置信度量化近期中间探测结果集中于主导答案的程度。当证据充分时,系统仅凭此单一信号进行全局控制:低置信度分支被剪枝,持续聚焦主答案的分支提前终止,释放计算资源用于分叉新分支,当置信加权投票高度集中时,生成过程全局停止。无需轨迹间同步,ParaTempo根据分支级收敛情况自适应分配计算。在挑战性数学与科学推理基准测试中,ParaTempo将平均延迟降低21.8%-32.2%,总令牌用量减少18.1%-30.3%,同时保持竞争性准确率。此外,时间置信度相比词元级与瞬时信号具有更强的时间稳定性与未来收敛预测能力。

原文摘要 · Abstract (English)

Parallel reasoning improves the accuracy and robustness of large reasoning models by exploring multiple solution paths, but its computational cost grows with reasoning depth and branch count. Existing methods for managing these parallel paths typically rely on final-answer consensus, local token confidence, or isolated intermediate probes. However, these signals are often delayed, weakly tied to actual reasoning progress, or too noisy for dynamic, branch-level control. To address these limitations, we introduce ParaTempo, a training-free asynchronous parallel reasoning framework. ParaTempo is driven by temporal confidence, a branch-local measure of answer-space convergence. Each branch is periodically probed for a tentative answer probability distribution, and temporal confidence quantifies how sharply the recent intermediate probes concentrate on a dominant answer. Once sufficient evidence has accumulated, ParaTempo drives its entire control process from this single signal: low-confidence branches are pruned, branches that persistently commit to their dominant answer are retired early, freed computation is reallocated by forking new branches, and generation stops globally once the confidence-weighted vote concentrates. Without requiring synchronization among reasoning trajectories, ParaTempo adaptively allocates computation based on branch-level convergence. Experiments on challenging mathematical and scientific reasoning benchmarks show that ParaTempo reduces average latency by 21.8-32.2% and total token usage by 18.1-30.3% while maintaining competitive accuracy. Moreover, temporal confidence exhibits stronger temporal stability and predictive power for future branch convergence than token-level and instantaneous signals.

并行推理效率优化置信度机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。