arXiv:2512.23167cs.AIcs.LG2025-12AAAI被引 8

用三类AI协作,在复杂任务中实现自纠错式智能规划。

SPIRAL: Symbolic LLM Planning via Grounded and Reflective Search

  • 引入三个专用AI代理,分别负责规划、模拟和反思,嵌入搜索循环中。
  • 在真实任务数据集上准确率达83.6%,比最优对比方法高出16个百分点。
  • 适合需要高可靠性和自主决策的AI系统开发者参考。

大型语言模型在需探索与自我修正的复杂规划任务中表现不佳,因其线性推理难以纠正早期错误。虽然蒙特卡洛树搜索(MCTS)可探索备选方案,但在稀疏奖励下效果有限,且未能充分利用语言模型的语义能力。我们提出SPIRAL(基于具身与反思搜索的符号化LLM规划),将三种专用语言模型代理嵌入MCTS循环:规划者提出创新步骤,模拟器通过预测真实结果实现搜索具身化,批判者通过反思提供密集奖励信号。三者协同使MCTS从盲目搜索转变为有指导、可自纠的推理过程。在DailyLifeAPIs和HuggingFace数据集上,SPIRAL持续优于默认思维链规划法及其他先进代理。尤其在DailyLifeAPIs上达到83.6%的整体准确率,较次优搜索框架提升超16个百分点,同时展现更优的令牌效率。本工作证明,将语言模型推理结构为具身、反思与引导的搜索过程,可生成更鲁棒高效的自主规划者。源代码、完整附录及所有实验数据可在官方项目仓库获取以供复现。

原文摘要 · Abstract (English)

Large Language Models (LLMs) often falter at complex planning tasks that require exploration and self-correction, as their linear reasoning process struggles to recover from early mistakes. While search algorithms like Monte Carlo Tree Search (MCTS) can explore alternatives, they are often ineffective when guided by sparse rewards and fail to leverage the rich semantic capabilities of LLMs. We introduce SPIRAL (Symbolic LLM Planning via Grounded and Reflective Search), a novel framework that embeds a cognitive architecture of three specialized LLM agents into an MCTS loop. SPIRAL's key contribution is its integrated planning pipeline where a Planner proposes creative next steps, a Simulator grounds the search by predicting realistic outcomes, and a Critic provides dense reward signals through reflection. This synergy transforms MCTS from a brute-force search into a guided, self-correcting reasoning process. On the DailyLifeAPIs and HuggingFace datasets, SPIRAL consistently outperforms the default Chain-of-Thought planning method and other state-of-the-art agents. More importantly, it substantially surpasses other state-of-the-art agents; for example, SPIRAL achieves 83.6% overall accuracy on DailyLifeAPIs, an improvement of over 16 percentage points against the next-best search framework, while also demonstrating superior token efficiency. Our work demonstrates that structuring LLM reasoning as a guided, reflective, and grounded search process yields more robust and efficient autonomous planners. The source code, full appendices, and all experimental data are available for reproducibility at the official project repository.

LLM规划自主决策搜索算法AI代理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。