构建首个支持多体物理交互的动态新视角合成基准
PhysGaia: A Physics-Aware Benchmark with Multi-Body Interactions for Dynamic Novel View Synthesis
- 用材料特异性物理求解器生成真实力交互场景
- 涵盖液体、气体、织物等非刚性物体,含粒子轨迹真值
- 适合研究物理一致动态重建与深度学习融合的学者
我们提出PhysGaia,一个面向动态新视角合成(DyNVS)的物理感知基准,包含结构化物体与非结构化物理现象。现有数据集多聚焦于外观保真度,而PhysGaia专为物理一致性动态重建设计。其场景包含复杂的多体交互,物体真实碰撞并传递力。涵盖液体、气体、纺织物及流变物质等多种材料,突破以往刚体假设。所有场景均通过材料专用物理求解器生成,严格遵守基本物理定律。提供完整真值信息,包括3D粒子轨迹和物理参数(如粘度),支持物理建模的量化评估。我们还提供近期4D高斯点云模型的集成管道及运行结果,助力研究落地。该基准填补了物理感知数据集的空白,可显著推动动态视图合成、物理驱动场景理解及深度学习与物理模拟融合的研究,实现更真实的复杂动态场景重建与解析。
原文摘要 · Abstract (English)
We introduce PhysGaia, a novel physics-aware benchmark for Dynamic Novel View Synthesis (DyNVS) that encompasses both structured objects and unstructured physical phenomena. While existing datasets primarily focus on photorealistic appearance, PhysGaia is specifically designed to support physics-consistent dynamic reconstruction. Our benchmark features complex scenarios with rich multi-body interactions, where objects realistically collide and exchange forces. Furthermore, it incorporates a diverse range of materials, including liquid, gas, textile, and rheological substance, moving beyond the rigid-body assumptions prevalent in prior work. To ensure physical fidelity, all scenes in PhysGaia are generated using material-specific physics solvers that strictly adhere to fundamental physical laws. We provide comprehensive ground-truth information, including 3D particle trajectories and physical parameters (e.g., viscosity), enabling the quantitative evaluation of physical modeling. To facilitate research adoption, we also provide integration pipelines for recent 4D Gaussian Splatting models along with our dataset and their results. By addressing the critical shortage of physics-aware benchmarks, PhysGaia can significantly advance research in dynamic view synthesis, physics-based scene understanding, and the integration of deep learning with physical simulation, ultimately enabling more faithful reconstruction and interpretation of complex dynamic scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。