动态构建推理图,让大模型在测试时自动选择最优思考路径。
Adaptive Graph of Thoughts: Test-Time Adaptive Reasoning Unifying Chain, Tree, and Graph Structures
- 通过递归分解问题生成动态有向无环图,智能分配计算资源。
- 在科学推理任务上提升46.2%,接近强化学习效果且无需额外训练。
- 适合需要高效、自适应推理的场景,如复杂问答与数学求解。
大型语言模型虽具强大推理能力,但性能高度依赖提示策略和模型规模。现有增强方法如强化学习和微调需大量计算与数据开销。本文提出自适应思维图(AGoT),一种仅在测试阶段运行的动态图式推理框架。不同于固定步骤的链式或树式思考,AGoT将复杂问题递归分解为结构化子问题,构建动态有向无环图(DAG),仅对需深入分析的子问题进行扩展。该方法融合链式、树式与图式推理优势,实现计算资源的精准分配。在多跳检索、科学推理与数学求解等多样化基准上验证,其在科学推理任务(GPQA)上实现最高46.2%的性能提升,媲美计算密集型强化学习方案,优于当前主流迭代方法。结果表明,动态分解与结构化递归为后训练优化提供了可扩展、低成本的新路径,推动大模型向更鲁棒、通用的推理能力演进。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated impressive reasoning capabilities, yet their performance is highly dependent on the prompting strategy and model scale. While reinforcement learning and fine-tuning have been deployed to boost reasoning, these approaches incur substantial computational and data overhead. In this work, we introduce Adaptive Graph of Thoughts (AGoT), a dynamic, graph-based inference framework that enhances LLM reasoning solely at test time. Rather than relying on fixed-step methods like Chain of Thought (CoT) or Tree of Thoughts (ToT), AGoT recursively decomposes complex queries into structured subproblems, forming an dynamic directed acyclic graph (DAG) of interdependent reasoning steps. By selectively expanding only those subproblems that require further analysis, AGoT unifies the strengths of chain, tree, and graph paradigms into a cohesive framework that allocates computation where it is most needed. We validate our approach on diverse benchmarks spanning multi-hop retrieval, scientific reasoning, and mathematical problem-solving, achieving up to 46.2% improvement on scientific reasoning tasks (GPQA) - comparable to gains achieved through computationally intensive reinforcement learning approaches and outperforming state-of-the-art iterative approaches. These results suggest that dynamic decomposition and structured recursion offer a scalable, cost-effective alternative to post-training modifications, paving the way for more robust, general-purpose reasoning in LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。