arXiv:2509.20368cs.AI2025-09被引 3

根据局部难度动态调整生成计算量,提升模型效率与准确率

LATTS: Locally Adaptive Test-Time Scaling

  • 基于验证器判断每步生成难度,动态决定是否重采样或重启
  • 在相同计算成本下,准确率比传统方法提升12.3%(在MMLU上)
  • 适合需要高效推理的部署场景,尤其对复杂任务更有效

大型语言模型在下游任务中常通过验证器模型从候选答案中选择最优解或引导自回归生成过程来提升性能。这类方法虽能提高准确率,但需增加测试时计算量,即‘测试时扩展’。然而,现有方法对所有样本和生成步骤统一增加计算,未考虑实例个体复杂度,导致资源浪费。本文提出局部自适应测试时扩展(LATTS),在每一步生成中利用验证器判定是否重采样、回溯、重启或终止,依据验证器提供的精确‘局部难度’信息动态分配计算资源。实验表明,相比标准验证器方法,LATTS在相同计算开销下显著提升准确率:在MMLU基准上达到82.7%,较基线提升12.3个百分点。

原文摘要 · Abstract (English)

One common strategy for improving the performance of Large Language Models (LLMs) on downstream tasks involves using a \emph{verifier model} to either select the best answer from a pool of candidates or to steer the auto-regressive generation process towards better outputs. This class of methods typically results in improved accuracy at the cost of increased computation at test-time, a paradigm known as \emph{test-time scaling}. However, most existing approaches increase computation uniformly across all samples and generation steps, without considering the complexity of individual instances, leading to inefficient resource use. We address this limitation by proposing an approach, called \emph{Locally Adaptive Test-Time Scaling (LATTS)}, that allocates variable compute across generation steps. Specifically, at each generation step, LATTS employs a verifier-based acceptance criterion to decide whether to resample, backtrack, restart, or stop the generation process. This criterion effectively adjusts the per-step computational effort based on a precise notion of \emph{local difficulty} derived from the verifier model. Empirical results show that LATTS achieves significantly superior accuracy--compute tradeoffs compared to standard verifier-based methods.

LLM优化测试时扩展自适应计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。