arXiv:2606.09187cs.CV2026-06被引 2

让动态3D场景符合物理规律,生成更真实可交互的4D场景。

CP4D: Compositional Physics-aware 4D Scene Generation

论文配图:CP4D: Compositional Physics-aware 4D Scene Generation
图 1 · 摘自论文原文
  • 将静态环境与动态物体分开展示,分别建模并融合。
  • 结合物理模拟器与视频扩散模型,生成符合常识的运动轨迹。
  • 适合需要高真实感和物理一致性的虚拟场景生成任务。

4D生成(即动态3D生成)因其强大的时空建模能力,已成为快速发展的研究前沿。然而,现有方法通常无法捕捉底层物理规律,导致结果在物理上不一致且视觉上不可信。为克服这一局限,我们提出CP4D,一种基于组合物理感知的逼真4D场景合成新范式。受真实场景中静态背景与动态物体共存的启发,CP4D将4D生成重构为静态3D环境与物理驱动动态物体的整合。框架采用三阶段流程:首先,利用预训练专家模型分别生成环境与前景物体的高保真3D表示;其次,提出一种混合运动生成策略,融合物理模拟器先验与视频扩散模型中的常识信息,以生成物理合理的运动轨迹与真实交互;最后,开发自动化组合机制,无缝融合静态环境与动态物体,生成连贯且物理一致的4D场景。大量实验表明,CP4D可生成可探索、可交互、高视觉保真度、强物理合理性与细粒度可控的4D场景,显著优于现有方法。

原文摘要 · Abstract (English)

4D generation (\textit{i.e.}, dynamic 3D generation) has recently emerged as a rapidly growing research frontier due to its powerful spatiotemporal modeling capabilities. However, despite notable advances, existing approaches typically fail to capture the underlying physical principles, producing results that are both physically inconsistent and visually implausible. To overcome this limitation, we present CP4D, a novel paradigm for photorealistic 4D scene synthesis with faithful adherence to complex physical dynamics. Drawing inspiration from the compositional nature of real-world scenes, where immutable static backgrounds coexist with dynamic, physically plausible foregrounds, CP4D reformulates 4D generation as the integration of a static 3D environment with physically grounded dynamic objects. On this basis, our framework follows a three-stage pipeline: \textbf{1)} Firstly, we leverage pre-trained expert models to generate high-fidelity 3D representations of the environment and foreground objects respectively. \textbf{2)} Subsequently, to produce physically plausible trajectories and realistic interactions for these objects, we propose a hybrid motion synthesis strategy that integrates priors from physical simulators with the common sense embedded in video diffusion models. \textbf{3)} Finally, we develop an automated composition mechanism that seamlessly fuses the static environment and dynamic objects into coherent, physically consistent 4D scenes. Extensive experiments demonstrate that CP4D can generate explorable and interactive 4D scenes with high visual fidelity, strong physical plausibility, and fine-grained controllability, significantly outperforming existing methods. The project page: https://anonymous.4open.science/w/CP4D/.

4D生成物理模拟场景合成视频生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。