arXiv:2604.16535cs.LGcs.AI2026-04

用少量校准数据训练轻量评分器,让大模型推理时更准更快。

SCATR: Simple Calibrated Test-Time Ranking

论文配图:SCATR: Simple Calibrated Test-Time Ranking
图 1 · 摘自论文原文
  • 基于基模型隐藏层特征,用小样本校准训练轻量评分器。
  • 在数学和编码任务上比原有信心方法提升最高9%,接近强学习评分器效果。
  • 参数量比微调少8000倍,训练和推理速度提升150倍和1000倍,适合部署。

测试时缩放(TTS)通过在推理时增加计算量来提升大语言模型性能。实践中常采用并行扩展:生成多个候选回复,通过最佳- N(BoN)策略选择最优结果。其效果依赖于评分函数。虽然过程奖励模型(PRM)等学习型评分器表现强劲,但训练和运行成本高。基于词元对数概率的轻量级置信度启发式方法成本低,但表现通常较差。为在不承担完整学习评分器开销的前提下改进轻量级置信度方法,我们提出SCATR:一种简单高效的BoN排序方法,通过小规模校准集从基模型的隐藏表示中学习轻量评分器。在代码与数学推理基准上,SCATR相比先前基于置信度的基线最高提升9%。相较于在同一校准数据上的LoRA微调,其准确率相当,但参数量减少高达8000倍,计算开销显著降低,训练与推理延迟分别降低最多150倍和1000倍。SCATR在多个场景下也优于强PRM基线,在数学任务上最高提升7.8%,在代码任务上提升4.2%,同时实现最高1000倍的推理加速。总体而言,SCATR为可扩展的测试时选择提供了优异的精度-效率平衡。

原文摘要 · Abstract (English)

Test-time scaling (TTS) improves large language models (LLMs) by allocating additional compute at inference time. In practice, TTS is often achieved through parallel scaling: generating multiple candidate responses and selecting the best via a Best-of-N (BoN) strategy. Its effectiveness therefore hinges on the scoring function. Learned scorers such as process reward models (PRMs) can be strong, but they are expensive to train and run. Lightweight confidence heuristics based on token log-probabilities are much cheaper, yet we find that they often perform substantially worse. To improve on lightweight confidence heuristics without incurring the full cost of stronger learned scorers, we introduce SCATR, a simple and efficient BoN ranking method that learns a lightweight scorer from a small calibration set using hidden representations from the base model. Across coding and mathematical reasoning benchmarks, SCATR improves over prior confidence-based baselines by up to 9%. Relative to LoRA fine-tuning on the same calibration data, it achieves comparable accuracy with up to 8000x fewer trainable parameters and much lower compute, reducing training and inference latency by up to 150x and 1000x, respectively. SCATR is also competitive with strong PRM baselines, and in several settings improves accuracy by up to 7.8% on math and 4.2% on coding while enabling up to 1000x faster inference. Overall, SCATR offers a strong accuracy-efficiency trade-off for scalable test-time selection.

测试时缩放轻量模型推理优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。