arXiv:2606.19354cs.CLcs.LG2026-06被引 1

根据计算预算和问题难度,动态调整验证粒度以提升大模型推理效率。

Granularity-Regulated Adaptive Computational Efficiency for Optimal Verification in Test-Time Scaling

论文配图:Granularity-Regulated Adaptive Computational Efficiency for Optimal Verification in Test-Time Scaling
图 1 · 摘自论文原文
  • 提出统一理论框架GRACE,明确最优验证粒度与问题难易、准确率和算力的关系。
  • 实证表明,自适应策略在相同算力下比固定粒度方法最高提升3.1%准确率。
  • 适用于需要高效推理的复杂数学问题求解场景,尤其适合算力受限时优化表现。

测试时扩展(TTS)通过在推理阶段投入更多计算资源,显著提升大语言模型的推理性能。其核心组件是验证器,用于筛选或评分候选解以指导搜索过程。尽管已有研究探讨了验证的益处,但一个基本问题仍被忽视:在给定算力预算下,验证的最佳粒度是什么?粗粒度结果奖励模型(ORMs)与细粒度过程奖励模型(PRMs)代表两种极端,但各自无法在所有场景下实现算力最优。本文提出统一理论框架——GRACE(Granularity-Regulated Adaptive Computational Efficiency),将最优验证粒度建模为问题难度、验证器准确率和算力预算的显式函数。我们证明存在相变现象:当算力充足或问题困难时,细粒度验证占优;而在低预算、简单问题场景下,粗粒度更优。该理论将Best-of-N、束搜索与步骤级MCTS统一于单一帕累托最优框架,并启发一种可证明达到算力-性能帕累托前沿的自适应粒度策略。在MATH-500、GSM8K和AIME基准上的实验证实了全部四项理论结论,自适应策略在匹配算力下较固定粒度基线最高提升3.1%准确率。

原文摘要 · Abstract (English)

Test-time scaling (TTS) has emerged as a powerful paradigm for improving the reasoning performance of large language models (LLMs) by investing additional compute at inference time. A central component of TTS is the \emph{verifier}, which selects or scores candidate solutions to guide the search process. While prior work has explored the benefit of verification, a fundamental question remains underexplored: \emph{what is the optimal granularity of verification under a given compute budget?} Coarse-grained outcome reward models (ORMs) and fine-grained process reward models (PRMs) represent two extremes, yet neither alone achieves compute-optimality across all regimes. In this paper, we establish a unified theoretical framework, called \textbf{GRACE} (\underline{G}ranularity-\underline{R}egulated \underline{A}daptive \underline{C}omputational \underline{E}fficiency), that characterizes the optimal verification granularity as an explicit function of problem difficulty, verifier accuracy, and compute budget. We prove that there exists a phase transition: fine-grained verification dominates when either the compute budget is large or the problem is hard, whereas coarse-grained verification is preferred in the low-budget, easy-problem regime. Our theory unifies Best-of-$N$, beam search, and step-level MCTS within a single Pareto-optimality framework, and motivates an adaptive granularity strategy that provably achieves the compute-performance Pareto frontier. Empirical results on MATH-500, GSM8K, and AIME benchmarks corroborate all four theoretical claims, with our adaptive strategy outperforming fixed-granularity baselines by up to 3.1\% accuracy at matched compute.

大模型推理算力优化验证机制自适应策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。