arXiv:2602.18886cs.CVcs.GR2026-02

用物理约束的凸体建模动态3D场景,兼顾视觉真实与力学一致性。

PhysConvex: Physics-Informed 3D Dynamic Convex Radiance Fields for Reconstruction and Simulation

  • 用连续介质力学驱动的凸体表示变形场,支持非均匀动态边界建模。
  • 通过神经皮肤特征模态实现异质材料高效模拟,降低自由度并保持精度。
  • 适合需要高保真物理仿真与视觉重建的动画、医疗或工业应用。

从视频中同时重建和模拟具有视觉真实感与物理一致性的动态三维场景仍是一项根本挑战。现有神经表示方法如NeRFs和3DGS在外观重建上表现优异,但难以捕捉复杂材料形变与动力学特性。我们提出PhysConvex——一种融合物理信息的3D动态凸体辐射场,统一视觉渲染与物理仿真。PhysConvex采用基于连续介质力学的物理驱动凸体来表示可变形辐射场,引入边界驱动的动态凸体表示,通过顶点与表面动力学建模空间自适应的非均匀形变及演化边界。为高效模拟复杂几何与异质材料,进一步构建降阶凸体仿真方法,利用神经皮肤特征模态作为形状与材料感知的形变基底,结合随时间变化的降阶自由度,在牛顿动力学下推进动态凸体场演化。凸体动力学提供紧凑且无间隙的体覆盖,提升几何效率与仿真保真度。实验表明,PhysConvex能从视频中高保真重建几何、外观与物理属性,优于现有方法。

原文摘要 · Abstract (English)

Reconstructing and simulating dynamic 3D scenes with both visual realism and physical consistency remains a fundamental challenge. Existing neural representations, such as NeRFs and 3DGS, excel in appearance reconstruction but struggle to capture complex material deformation and dynamics. We propose PhysConvex, a Physics-informed 3D Dynamic Convex Radiance Field that unifies visual rendering and physical simulation. PhysConvex represents deformable radiance fields using physically grounded convex primitives governed by continuum mechanics. We introduce a boundary-driven dynamic convex representation that models deformation through vertex and surface dynamics, capturing spatially adaptive, non-uniform deformation, and evolving boundaries. To efficiently simulate complex geometries and heterogeneous materials, we further develop a reduced-order convex simulation that advects dynamic convex fields using neural skinning eigenmodes as shape- and material-aware deformation bases with time-varying reduced DOFs under Newtonian dynamics. Convex dynamics also offers compact, gap-free volumetric coverage, enhancing both geometric efficiency and simulation fidelity. Experiments demonstrate that PhysConvex achieves high-fidelity reconstruction of geometry, appearance, and physical properties from videos, outperforming existing methods.

3D重建物理仿真动态场景凸体建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。