arXiv:2606.07326cs.CV2026-06

通过视点定制实现可自演化的人体视角世界模拟

AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customization

论文配图:AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customization
图 1 · 摘自论文原文
  • 以3D人体动作为主交互,辅以外部视角监督提升空间感知
  • 通过锚定视图与文本描述实现场景动态演变,保持时空一致性
  • 适合需要高可控性交互模拟的虚拟现实与机器人训练场景

尽管交互式世界建模是重要前沿,但在实际应用场景中仍缺乏足够的可控性。为此,我们提出AnchorWorld框架,通过增强交互完整性与灵活的世界定制机制,推进人体视角模拟。首先,采用3D人体运动作为主要交互方式;为弥补第一人称视角下身体部分被遮挡或截断的问题,引入独立于主体感官的外部视角辅助训练监督,使模型能观测到主体与环境的完整空间关系,从而更稳健地实现人-环境交互的空间定位。此外,我们提出一种简单有效的自演化世界定制机制:在统一世界坐标系中定义锚定视图,并结合文本描述控制局部场景的动态演化。实验结果表明,AnchorWorld显著优于现有先进基线,消融实验验证了关键设计的有效性。值得注意的是,其定制方案展现出良好的时空几何一致性,并严格遵循预设的演化规律。

原文摘要 · Abstract (English)

Despite being a pivotal frontier, interactive world modeling remains underexplored in terms of the versatile controllability required by practical scenarios. To bridge this gap, we present AnchorWorld, a framework that advances egocentric simulation through enhanced interaction integrity and a flexible mechanism for world customization. First, we utilize 3D human motion as the primary interaction modality. To complement the out-of-view or truncated body parts in egocentric views, we introduce an auxiliary training supervision that incorporates exogenous viewpoints decoupled from the agent's first-person sensorium. It allows the model to observe the agent's full-body positioning relative to the environment, facilitating a more robust spatial grounding of human-world interactions. Furthermore, we propose a simple yet effective mechanism for customizing self-evolving worlds. This is achieved by defining anchor views within a unified world coordinate system, coupled with textual descriptions dictating the dynamic evolution of local scenes. Experimental results show that AnchorWorld significantly outperforms state-of-the-art baselines, while ablation studies validate the effectiveness of our key designs. Notably, our customization scheme exhibits promising spatio-temporal geometric consistency and adheres strictly to the prescribed evolutionary dynamics.

世界建模人体交互自演化视角融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。