用经验提炼的关键事实增强大模型规划,提升复杂任务中的决策能力。
Fact-Augmented Lookahead Planning for LLM Agents
- 从交互轨迹中提取关键事实,通过一致性过滤筛选
- 基于事实条件进行递归深度搜索,提升长期规划效果
- 无需参数更新即可在线优化,适合长周期任务
大型语言模型在日益复杂任务中表现强劲,但其智能体在交互性、部分可观测、长时程环境中仍面临规划困难,尤其当搜索无引导或近期历史不足时。本文提出 LWM-Planner,一种基于事实的前瞻规划框架,仅通过上下文学习实现行为改进。每个回合结束后,智能体从轨迹中提取任务关键原子事实,经轻量级预测一致性过滤(可选压缩),并利用所得事实集来条件化动作提议、单步隐空间世界模型模拟与状态价值估计。规划过程基于累积事实与近期历史,进行递归深度限制的候选轨迹搜索,实现无需参数更新的在线优化。我们以抽象视角论证:将事实视为减少状态混淆(代理 $ε_{\mathrm{sim}}$)并使事实条件模拟降低一步误差(代理 $δ_{\mathrm{model}}$)。实验证明,在文本版 FrozenLake、CrafterMini 和 ALFWorld 上,该方法在累积回报上优于 ReAct/Reflexion 及纯搜索基线,表明测试时搜索最有效的情形是其由紧凑、经验衍生的事实所锚定。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly capable, but LLM agents still struggle to plan effectively in interactive, partially observable, long-horizon environments when search is unguided or recent history is insufficient. We introduce LWM-Planner, a fact-augmented lookahead planning framework that improves agent behavior purely through in-context learning. After each episode, the agent extracts task-critical atomic facts from its trajectories, validates candidates with a lightweight predictive-consistency filter (and optionally compresses them), and uses the resulting fact set to condition action proposal, single-step latent world-model simulation, and state-value estimation. Planning then proceeds via recursive, depth-limited lookahead over candidate trajectories conditioned on the accumulated facts and recent history, enabling online improvement without parameter updates. We provide abstraction-style motivation: treating facts as reducing state aliasing (proxy $ε_{\mathrm{sim}}$) and fact-conditioned simulation as lowering one-step error (proxy $δ_{\mathrm{model}}$), without claiming formal guarantees. Empirically, on text FrozenLake variants, CrafterMini, and ALFWorld, the approach improves cumulative return over ReAct/Reflexion and search-only baselines, suggesting that additional test-time search is most useful when grounded by compact, experience-derived facts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。