用多智能体反馈让大模型自动生成可执行的世界模型。
Agent2World: Learning to Generate Symbolic World Models via Adaptive Multi-Agent Feedback
- 通过多智能体协作生成并验证世界模型,动态捕捉行为错误。
- 在三个基准上达到当前最优,生成模型平均提升30.95%。
- 适合做规划、具身智能和世界模型训练的研究者。
符号化世界模型(如PDDL领域或可执行模拟器)是基于模型规划的核心,但训练大模型生成此类模型受限于缺乏大规模可验证的监督信号。现有方法依赖静态验证,难以发现交互执行中的行为级错误。本文提出Agent2World,一个工具增强的多智能体框架,实现强推理时世界模型生成,并作为监督微调的数据引擎。该框架采用三阶段流程:(i) Deep Researcher智能体通过网络搜索填补规范空白;(ii) Model Developer智能体实现可执行世界模型;(iii) Testing Team进行自适应单元测试与基于模拟的验证。Agent2World在涵盖PDDL和可执行代码表示的三个基准上均表现优异,持续取得领先结果。此外,Testing Team为Model Developer提供行为感知的自适应反馈,形成多轮训练轨迹。在这些轨迹上微调的模型相比未训练版本,世界模型生成能力平均提升30.95%。
原文摘要 · Abstract (English)
Symbolic world models (e.g., PDDL domains or executable simulators) are central to model-based planning, but training LLMs to generate such world models is limited by the lack of large-scale verifiable supervision. Current approaches rely primarily on static validation methods that fail to catch behavior-level errors arising from interactive execution. In this paper, we propose Agent2World, a tool-augmented multi-agent framework that achieves strong inference-time world-model generation and also serves as a data engine for supervised fine-tuning, by grounding generation in multi-agent feedback. Agent2World follows a three-stage pipeline: (i) A Deep Researcher agent performs knowledge synthesis by web searching to address specification gaps; (ii) A Model Developer agent implements executable world models; And (iii) a specialized Testing Team conducts adaptive unit testing and simulation-based validation. Agent2World demonstrates superior inference-time performance across three benchmarks spanning both Planning Domain Definition Language (PDDL) and executable code representations, achieving consistent state-of-the-art results. Beyond inference, Testing Team serves as an interactive environment for the Model Developer, providing behavior-aware adaptive feedback that yields multi-turn training trajectories. The model fine-tuned on these trajectories substantially improves world-model generation, yielding an average relative gain of 30.95% over the same model before training. Project page: https://agent2world.github.io.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。