用世界模型模拟未来,让智能体像人一样主动规划任务。
General Agentic Planning Through Simulative Reasoning with World Models
- 用大模型构建内部世界模型,通过模拟预测行动后果来决策。
- 在三类任务中任务完成率最高提升124%,导航成功率从0%升至32.2%。
- 适合需要跨任务迁移能力的复杂智能体系统设计者参考。
当前智能体系统多依赖反应式决策,仅通过固定流程选择下一步动作,缺乏对未来结果的显式建模,导致泛化能力差。人类则通过内在世界模型进行心理模拟(即模拟推理),实现灵活的目标导向行为。本文提出SiRA架构,基于大模型构建世界模型,以自然语言表示信念状态,实现目标导向的模拟推理。在网页环境下的三类任务中评估:受限导航、多跳信息聚合和通用指令遵循。结果显示,模拟推理相比基准反应式系统,任务完成率最高提升124%,受限导航成功率达32.2%,而原开放网络代理为0%。跨任务持续优势表明该方法具备可迁移的反事实评估能力。
原文摘要 · Abstract (English)
What does it mean to plan? Current agentic systems, whether scaffolded workflows or end-to-end policies, rely on reactive decision-making: selecting the next action via a fixed procedure with at most undifferentiated adaptive computation (e.g., chain-of-thought) lacking explicit modeling of future outcomes. This limits generalizability, as each new task demands re-engineering rather than transfer of shared reasoning capacity. Humans, by contrast, plan by mentally simulating consequences of candidate actions within an internal world model, a capacity known as simulative reasoning (System II) that supports flexible, goal-directed behavior across diverse contexts. We argue that simulative reasoning through a world model provides a general-purpose planning mechanism for agentic systems, improving upon reactive policies (System I) by grounding decisions in predicted future states rather than pattern-matched responses. To verify this, we introduce SiRA (Simulative Reasoning Architecture), a goal-oriented architecture instantiating simulative reasoning using an LLM-based world model with natural-language belief states, while remaining model-agnostic. We evaluate across three qualitatively distinct task categories: constrained navigation, multi-hop information aggregation, and general instruction following, in a web-browser environment. Across all categories, simulative reasoning achieves up to 124% higher task completion rates than a matched reactive baseline, and increases constrained navigation success from 0% to 32.2% compared to a representative open-web agent. The persistent advantage across distinct task types suggests the benefit stems from generalizable counterfactual evaluation rather than task-specific tuning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。