arXiv:2605.19957cs.CVcs.AI2026-05被引 1

分离世界与机器人自身动态,提升复杂任务长期规划能力

World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Tasks

论文配图:World-Ego Modeling for Long-Horizon Evolution in Hybrid Embodied Tasks
图 1 · 摘自论文原文
  • 将世界与机器人行为解耦,分别建模持久环境与指令驱动动作
  • 在125K视频数据上实现领先性能,支持超2000条多轮指令推理
  • 适合研究长时序智能体任务规划、具身学习的学者与开发者

世界模型在具身智能中广泛应用,但通常将世界与机器人自身动态混杂在同一流中:世界捕捉不随指令变化的场景规律,而机器人自身捕捉受指令驱动的动态。这种纠缠导致在包含导航与操作交替的混合任务中,长期规划性能下降。本文提出「世界-自我建模」新范式,将未来演化分解为世界与自我两部分。从运动、语义和意图三个视角定义边界,并分析了后置、前置、全阶段三种解耦策略。进一步构建了统一的世界模型WEM,结合隐式分离的世界-自我规划器与级联并行专家混合(CP-MoE)扩散生成器。为严格评估,构建首个长时序混合任务基准HTEWorld,包含12.5万段视频(超450万帧)、细粒度动作标注及300条多轮评估轨迹(超2000条指令)。大量实验表明,WEM在HTEWorld上达到当前最佳表现,同时在已有操作类基准上保持竞争力。

原文摘要 · Abstract (English)

World models are widely explored in embodied intelligence, yet they typically predict distinct evolutions of the world and the ego within a single stream, where the world captures persistent instruction-agnostic scene regularities and the ego captures robot-centric instruction-conditioned dynamics. This world-ego entanglement leads to a degradation in long-horizon embodied scenarios, particularly in hybrid tasks with interleaved navigation and manipulation behaviors. In this paper, we introduce \emph{World-Ego Modeling}, a new conceptual paradigm that decomposes future evolution into world and ego components. We define the world-ego boundary from three perspectives, i.e., motion-, semantic-, and intention-based views, and analyze three disentanglement strategies with post-, pre-, and full disentanglement. Further, we instantiate this paradigm as the World-Ego Model (WEM), a unified embodied world model that couples an implicit separate world-ego planner with a cascade-parallel mixture-of-experts (CP-MoE) diffusion generator. To enable rigorous evaluation, we further construct HTEWorld, the first benchmark for long-horizon world modeling with hybrid navigation-manipulation tasks, providing 125K video clips (over 4.5M frames) with fine-grained action annotations and 300 multi-turn evaluation trajectories (over 2K instructions). Extensive experiments show that WEM achieves state-of-the-art performance on HTEWorld while remaining competitive on existing manipulation-only benchmarks.

具身智能世界模型长时序规划扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。