大模型在规划任务中接近理论最优,超越传统搜索算法。
Analysis of Optimality of Large Language Models on Planning Problems
- 通过块世界与路径星图任务,测试模型是否真正优化而非依赖经验策略。
- 复杂多目标场景下,大模型成功率接近理论最优,传统算法性能急剧下降。
- 适合研究模型推理机制、认知计算或智能规划的读者。
经典人工智能规划问题在大语言模型时代被重新审视,现有基准多关注成功率而忽视计划效率。本文研究前沿模型在规划任务中是否真正实现最优推理,还是依赖简单启发式策略。聚焦于需将标记积木塔从初始状态移动到目标状态的块世界任务,以及形式上等价的广义路径星图(P*)任务,以剥离语义先验影响。系统性地改变问题深度(积木塔高度)、宽度(塔的数量)和组合性(目标积木数)。增强推理的大模型在复杂多目标配置中显著优于传统满足型规划器(如LAMA)。尽管经典搜索算法随搜索空间扩大而失效,大模型仍能近乎完美地逼近理论最优解,即使去除领域特定语义提示。为解释这一现象,提出并验证两个假设:基于推理令牌的主动算法模拟,以及可表示P*拓扑结构的几何记忆,使模型能绕过指数级组合复杂度。
原文摘要 · Abstract (English)
Classic AI planning problems have been revisited in the Large Language Model (LLM) era, with a focus of recent benchmarks on success rates rather than plan efficiency. We examine the degree to which frontier models reason optimally versus relying on simple, heuristic, and possibly inefficient strategies. We focus on the Blocksworld domain involving towers of labeled blocks which have to be moved from an initial to a goal configuration via a set of primitive actions. We also study a formally equivalent task, the generalized Path-Star ($P^*$) graph, in order to isolate true topological reasoning from semantic priors. We systematically manipulate problem depth (the height of block towers), width (the number of towers), and compositionality (the number of goal blocks). Reasoning-enhanced LLMs significantly outperform traditional satisficing planners (e.g., LAMA) in complex, multi-goal configurations. Although classical search algorithms hit a wall as the search space expands, LLMs track theoretical optimality limits with near-perfect precision, even when domain-specific semantic hints are stripped away. To explain these surprising findings, we consider (and find evidence to support) two hypotheses: an active Algorithmic Simulation executed via reasoning tokens and a Geometric Memory that allows models to represent the $P^*$ topology as a navigable global geometry, effectively bypassing exponential combinatorial complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。