通过定位错误提升大模型推理效率,减少冗余计算
Test-Time Scaling via Error Localization
- 基于反馈对比概率,精准定位错误出现的词元位置
- 在多个推理任务中实现更高准确率且用更少生成词元
- 适合追求高效推理的大模型应用开发者
扩大推理时计算量已成为提升大语言模型在复杂推理与编程任务中表现的可靠方法。然而,标准方法如独立采样和顺序多轮优化缺乏词元级责任分配,导致计算效率低下,因为有效推理前缀常被丢弃。本文提出测试时扩展的错误定位方法(TTEL),利用固定或环境反馈进行词元级错误定位。通过比较有反馈条件下的条件概率与无反馈基线,TTEL可识别错误发生的具体步骤,随后截断轨迹并分支新生成路径,最大限度复用有效前缀。大量评估显示,TTEL在序列推理领域实现了严格占优的帕累托前沿,以通过率(pass-at-k)与生成词元成本为指标。在LiveCodeBench上,Qwen3-8B使用TTEL达到pass@64为71.0%,生成词元数约360.4k,仅为独立采样的半数(735.0k)。推广至数学基准AIME-2025和HMMT-2025,TTEL在Qwen3-8B和Qwen3-4B-Thinking-2507上均显著优于其他测试时基线。
原文摘要 · Abstract (English)
Scaling inference-time computation has emerged as a reliable method to improve the performance of large language models on complex reasoning and programming tasks. However, standard approaches such as independent sampling and sequential multi-turn refinement operate without token-level credit assignment, resulting in computational inefficiency, since valid reasoning prefixes are frequently discarded. In this work, we introduce Test-Time Scaling via Error Localization (TTEL), an inference-time algorithm that utilizes fixed or environment feedback to perform token-level error localization. By comparing conditional probabilities under informed feedback against a null-context baseline, TTEL isolates the step at which an error occurred. The algorithm then truncates the trajectory and branches a new generation, maximally reusing the valid prefix. Extensive evaluations demonstrate that TTEL establishes strictly dominating Pareto frontiers across sequential reasoning domains, measured by pass-at-k vs. generated-token cost. With Qwen3-8B on LiveCodeBench, TTEL attains a pass@64 of 71.0% while generating approximately half as many tokens as independent sampling (360.4k vs. 735.0k). Generalizing to math benchmarks AIME-2025 and HMMT-2025, TTEL cleanly outperforms competing test-time baselines across both Qwen3-8B and Qwen3-4B-Thinking-2507.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。