arXiv:2505.13672cs.AI2025-05被引 4

用搜索算法优化推理效率,少用 tokens 达到更强推理能力。

A*-Decoding: Token-Efficient Inference Scaling

  • 基于A*搜索构建结构化推理路径选择策略。
  • 在相同算力下,比基线少用3倍tokens,少30%评分器调用。
  • 适合资源有限但需强推理的轻量级模型部署场景。

推理阶段的扩展已成为提升语言模型在复杂推理任务中表现的强大替代方案。尽管现有方法在固定计算预算下已取得显著性能提升,但对如何高效利用该预算关注较少。本文提出A*-解码,一种基于A*搜索算法的推理策略,通过优先选择高质量推理路径来最优利用固定计算资源。我们将语言模型解码建模为部分解空间中的结构化搜索,利用外部过程监督信号指导A*转移模型识别有前景的延续。实验表明,A*-解码在等效计算预算下,性能达到best-of-N和粒子滤波等强基线水平,同时减少最多3倍的token消耗和30%的PRM调用次数。在MATH500和AIME 2024基准上,Llama-3.2-1B-Instruct的表现可媲美70倍更大的Llama-3.1-70B-Instruct,Qwen3-1.7B亦实现接近o1的推理精度。结果凸显了结构化搜索在解码中的潜力,为避免暴力采样或依赖规模增长提供了新方向。本工作展示了精心设计的推理策略如何增强小型模型的推理能力,指向更高效、可扩展的语言模型部署未来。

原文摘要 · Abstract (English)

Inference-time scaling has emerged as a powerful alternative to parameter scaling for improving language model performance on complex reasoning tasks. While existing methods have shown strong performance gains under fixed compute budgets, there has been little focus on optimally utilizing that budget during inference. In this work, we introduce A*-decoding, a search-based inference-time strategy that builds on the A* search algorithm to optimally utilize a fixed compute budget by prioritizing high-quality reasoning paths during generation. We frame language model decoding as a structured search in a state space of partial solutions, applying the A* transition model to identify promising continuations guided by an external process supervision signal. In our experiments, A*-decoding reaches the performance levels of strong inference scaling baselines like best-of-N and particle filtering while using up to 3x fewer tokens and 30% fewer PRM passes under equivalent compute budgets. On the MATH500 and AIME 2024 benchmarks, A*-decoding enables Llama-3.2-1B-Instruct to match the performance of the 70x larger Llama-3.1-70B-Instruct, and allows Qwen3-1.7B to reach o1-like reasoning accuracy. These results highlight the power of structured search in decoding, offering an alternative to brute-force sampling or scale-driven gains. Our work demonstrates how thoughtful inference-time strategies can enhance reasoning in SLMs, pointing toward future advances in more efficient and scalable language model deployment.

推理优化A*搜索轻量模型高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。