arXiv:2505.24550cs.CL2025-05NeurIPS被引 7

用双向压缩提升低资源下的推理效率,显著缩短思考路径。

A*-Thought: Efficient Reasoning via Bidirectional Compression for Low-Resource Settings

  • 构建搜索树,通过A*算法筛选高信息密度的推理节点
  • 在数学任务上使QwQ-32B性能提升2.39倍,输出长度减半
  • 兼容多种大模型,适合资源受限场景的高效推理

大型推理模型(LRMs)通过延长思考链实现优异表现,但过长的推理轨迹会降低效率。现有方法多假设存在过度思考,尝试压缩思维链以提升效率,却常导致性能下降。为此,我们提出A*-Thought,一种基于树搜索的统一框架,旨在从大规模推理链中识别并分离最关键的推理片段。该方法将LRM的推理过程建模为搜索树,每个节点代表推理空间中的一个推理段。结合针对推理路径设计的代价函数与A*搜索算法,能高效压缩思维链,找到信息密度高且代价低的推理路径。此外,我们还提出双向重要性估计机制,进一步优化搜索过程,超越均匀采样。在多个先进数学任务上的大量实验表明,A*-Thought能在巨大搜索空间中有效平衡性能与效率。具体而言,使用低预算时,可使QwQ-32B性能提升2.39倍;使用高预算时,输出词元长度减少近50%。所提方法还可适配其他多个LRMs,展现出良好的泛化能力。代码已开源:https://github.com/AI9Stars/AStar-Thought。

原文摘要 · Abstract (English)

Large Reasoning Models (LRMs) achieve superior performance by extending the thought length. However, a lengthy thinking trajectory leads to reduced efficiency. Most of the existing methods are stuck in the assumption of overthinking and attempt to reason efficiently by compressing the Chain-of-Thought, but this often leads to performance degradation. To address this problem, we introduce A*-Thought, an efficient tree search-based unified framework designed to identify and isolate the most essential thoughts from the extensive reasoning chains produced by these models. It formulates the reasoning process of LRMs as a search tree, where each node represents a reasoning span in the giant reasoning space. By combining the A* search algorithm with a cost function specific to the reasoning path, it can efficiently compress the chain of thought and determine a reasoning path with high information density and low cost. In addition, we also propose a bidirectional importance estimation mechanism, which further refines this search process and enhances its efficiency beyond uniform sampling. Extensive experiments on several advanced math tasks show that A*-Thought effectively balances performance and efficiency over a huge search space. Specifically, A*-Thought can improve the performance of QwQ-32B by 2.39$\times$ with low-budget and reduce the length of the output token by nearly 50% with high-budget. The proposed method is also compatible with several other LRMs, demonstrating its generalization capability. The code can be accessed at: https://github.com/AI9Stars/AStar-Thought.

推理压缩A*搜索低资源推理思维链

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。