用最短路径最先完成的推理结果,显著提升大模型准确率。
First Finish Search: Efficient Test-Time Scaling in Large Language Models
- 并行生成多个样本,首个完成即返回
- 在AIME数据集上达82.23%准确率,提升15%
- 无需训练,适合推理加速与低延迟场景
测试时扩展(TTS)通过动态分配推理计算量,可有效提升大语言模型的推理能力。现有方法常依赖长解码路径或大量样本生成,导致令牌使用和延迟增加。我们发现,在推理任务中,较短的推理路径更可能正确。基于此,提出无需训练的并行解码策略First Finish Search(FFS):同时启动n个独立样本,一旦任一完成即返回结果。在DeepSeek-R1、R1-Distill-Qwen-32B、QwQ-32B和Phi-4-Reasoning-Plus四个模型上,对AIME24、AIME25-I、AIME25-II和GPQA Diamond四组数据集进行评估。使用DeepSeek-R1时,FFS在AIME数据集上达到82.23%准确率,相较其原生准确率提升15%,接近OpenAI o4-mini表现。理论分析表明,提前停止于最短路径通常能获得正确答案,并揭示了早期停止可能失效的条件。该方法简洁优雅,证明简单TTS策略在推理阶段具有巨大潜力。
原文摘要 · Abstract (English)
Test-time scaling (TTS), which involves dynamic allocation of compute during inference, offers a promising way to improve reasoning in large language models. While existing TTS methods work well, they often rely on long decoding paths or require a large number of samples to be generated, increasing the token usage and inference latency. We observe the surprising fact that for reasoning tasks, shorter traces are much more likely to be correct than longer ones. Motivated by this, we introduce First Finish Search (FFS), a training-free parallel decoding strategy that launches $n$ independent samples and returns as soon as any one completes. We evaluate FFS alongside simple decoding, beam search, majority voting, and budget forcing on four reasoning models (DeepSeek-R1, R1-Distill-Qwen-32B, QwQ-32B and Phi-4-Reasoning-Plus) and across four datasets (AIME24, AIME25-I, AIME25-II and GPQA Diamond). With DeepSeek-R1, FFS achieves $82.23\%$ accuracy on the AIME datasets, a $15\%$ improvement over DeepSeek-R1's standalone accuracy, nearly matching OpenAI's o4-mini performance. Our theoretical analysis explains why stopping at the shortest trace is likely to yield a correct answer and identifies the conditions under which early stopping may be suboptimal. The elegance and simplicity of FFS demonstrate that straightforward TTS strategies can perform remarkably well, revealing the untapped potential of simple approaches at inference time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。