arXiv:2604.09580cs.AIcs.LG2026-04被引 1

用程序化世界模型让大模型更懂机器人任务中的物体关系与逻辑。

OOWM: Structuring Embodied Reasoning and Planning via Object-Oriented Programmatic World Modeling

论文配图:OOWM: Structuring Embodied Reasoning and Planning via Object-Oriented Programmatic World Modeling
图 1 · 摘自论文原文
  • 把环境建模为对象与控制逻辑的显式符号结构,类比软件工程设计。
  • 在MRoom-30k上计划成功率提升27%,执行成功率达83.4%。
  • 适合做具身智能、机器人规划的研究者和开发者参考。

标准链式思维提示虽赋予大模型推理能力,但其依赖线性自然语言,在具身任务中难以有效建模世界。文本虽灵活,却无法显式表达状态空间、物体层次与因果依赖,影响机器人规划。为此,我们提出面向对象的世界建模(OOWM),将世界模型重构为显式符号元组 $W = \ langle S, T angle$:由状态抽象 $G_ ext{state}$ 表示环境状态 $S$,并由控制策略 $G_ ext{control}$ 表达转移逻辑 $T: S \times A \rightarrow S'$。OOWM采用统一建模语言(UML)实现:用类图将视觉感知转化为严谨的对象层次,用活动图将规划转化为可执行的控制流。此外,我们设计三阶段训练流程,结合监督微调(SFT)与组相对策略优化(GRPO),通过最终计划的结果奖励隐式优化对象化推理结构,即使标注稀疏也能有效学习。在MRoom-30k基准上的大量评估表明,OOWM显著优于无结构文本基线,在计划连贯性、执行成功率与结构保真度上均表现更优,确立了结构化具身推理的新范式。

原文摘要 · Abstract (English)

Standard Chain-of-Thought (CoT) prompting empowers Large Language Models (LLMs) with reasoning capabilities, yet its reliance on linear natural language is inherently insufficient for effective world modeling in embodied tasks. While text offers flexibility, it fails to explicitly represent the state-space, object hierarchies, and causal dependencies required for robust robotic planning. To address these limitations, we propose Object-Oriented World Modeling (OOWM), a novel framework that structures embodied reasoning through the lens of software engineering formalisms. We redefine the world model not as a latent vector space, but as an explicit symbolic tuple $W = \langle S, T \rangle$: a State Abstraction ($G_\text{state}$) instantiating the environmental state $S$, coupled with a Control Policy ($G_\text{control}$) representing the transition logic $T: S \times A \rightarrow S'$. OOWM leverages the Unified Modeling Language (UML) to materialize this definition: it employs Class Diagrams to ground visual perception into rigorous object hierarchies, and Activity Diagrams to operationalize planning into executable control flows. Furthermore, we introduce a three-stage training pipeline combining Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO). Crucially, this method utilizes outcome-based rewards from the final plan to implicitly optimize the underlying object-oriented reasoning structure, enabling effective learning even with sparse annotations. Extensive evaluations on the MRoom-30k benchmark demonstrate that OOWM significantly outperforms unstructured textual baselines in planning coherence, execution success, and structural fidelity, establishing a new paradigm for structured embodied reasoning.

具身智能世界模型机器人规划大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。