arXiv:2502.12018cs.CLcs.AI2025-02NeurIPS被引 70

提出原子思维单元,让大模型推理更高效省资源。

Atom of Thoughts for Markov LLM Test-Time Scaling

  • 用马尔可夫过程设计无记忆推理链,减少历史依赖。
  • 在计算资源增加时,性能持续超越现有方法。
  • 适配各类大模型与推理框架,适合高并发场景。

大语言模型通过测试时扩展获得了显著性能提升,但现有方法常因推理中历史依赖信息累积导致冗余计算。为此,我们利用马尔可夫过程的无记忆特性,提出一种马尔可夫推理机制,使推理过程摆脱对历史上下文的依赖,实现与各类测试时扩展方法的无缝集成,从而提升扩展效率。进一步结合树搜索与反思优化等技术,我们发现了一种涌现的原子化推理结构——思维原子(Atom of Thoughts, \ our),其将推理轨迹分解为一系列自包含、低复杂度的原子单元。大量实验表明,随着计算预算增加,\ our始终优于现有基线。重要的是,该方法可无缝集成于不同推理框架与大模型(包括非推理类模型),支持可扩展的高性能推理。论文附代码,公开可用以促进复现与后续研究。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have achieved significant performance gains through test-time scaling methods. However, existing approaches often incur redundant computations due to the accumulation of historical dependency information during inference. To address this challenge, we leverage the memoryless property of Markov processes to minimize reliance on historical context and propose a Markovian reasoning process. This foundational Markov chain structure enables seamless integration with various test-time scaling methods, thereby improving their scaling efficiency. By further scaling up the Markovian reasoning chain through integration with techniques such as tree search and reflective refinement, we uncover an emergent atomic reasoning structure, where reasoning trajectories are decomposed into a series of self-contained, low-complexity atomic units. We name this design Atom of Thoughts (\our). Extensive experiments demonstrate that \our consistently outperforms existing baselines as computational budgets increase. Importantly, \our integrates seamlessly with existing reasoning frameworks and different LLMs (both reasoning and non-reasoning), facilitating scalable, high-performance inference.We submit our code alongside this paper and will make it publicly available to facilitate reproducibility and future research.

大模型推理思维原子测试时扩展马尔可夫链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。