arXiv:2606.26694cs.CV2026-06被引 1

构建可编辑物理世界的大规模数据集,支持重力等参数的可控实验。

PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models

论文配图:PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models
图 1 · 摘自论文原文
  • 基于UE5回放管线,记录多重重力下的统一动作序列与初始状态
  • 包含12个场景、超100小时交互、6000万帧渲染画面,含多模态同步信号
  • 适用于生成模型与世界理解模型的可控物理建模研究

当前游戏世界模型虽能生成视觉逼真的动作相关轨迹,但交互行为多限于探索性移动,物理动态通常作为隐含数据相关性学习,难以显式控制。这限制了其在人为设计规则的游戏环境中的应用。本文提出PhysEditWorld,一个以重力为核心参数的多模态物理可编辑数据集。基于UE5的回放与渲染管线,每个场景在相同初始状态、角色控制器、动作序列和摄像机策略下,通过不同重力配置进行多次回放,实现可控且可归因的物理变化。数据集包含12个电影级UE5场景,超过100小时的游戏交互,6000万帧以上渲染轨迹。每条样本同步提供RGB、深度、法线、音频、动作轨迹、相机路径、引擎状态、语义标注及显式重力标签。我们进一步在生成视频模型与世界理解模型上开展初步应用研究,证明该数据集可提升重力忠实度建模能力,增强物理编辑下的一致性,并为可控世界建模研究提供可扩展基础。

原文摘要 · Abstract (English)

Recent game world models can synthesize visually plausible, action-conditioned rollouts. However, their interaction behaviors often remain limited to exploratory or wandering trajectories, and physical dynamics are typically learned as implicit correlations from data rather than as controllable variables. This limitation hinders their applicability to authored game environments, where physical rules are deliberately designed and require explicit manipulation. We introduce PhysEditWorld, a multimodal dataset with physical parameters, with a primary focus on gravity in this initial version. At its core, PhysEditWorld is built upon a replay paradigm implemented with a UE5 replay-and-rendering pipeline. Each scenario records a normalized action trace and replays the same initial state, character controller, action sequence, and camera policy under multiple gravity configurations, enabling controlled and attributable physical variation. PhysEditWorld contains 12 cinematic UE5 scenes, over 100 hours of gameplay interactions, and more than 60 million rendered rollout frames. Each sample provides synchronized multimodal signals, including RGB, depth, normals, audio, action traces, camera trajectory, engine states, semantic annotations, and explicit gravity labels. We further conduct initial utility studies on both generative video models and world understanding models, demonstrating that PhysEditWorld enables improved gravity-faithful dynamics modeling, enhances consistency under physical edits, and provides a scalable foundation for controllable world modeling research.

世界建模物理编辑多模态数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。