4DSurf实现大变形动态场景高保真表面重建,时序一致性更强。
\textit{4DSurf}: High-Fidelity Dynamic Scene Surface Reconstruction
- 用高斯变形与符号距离函数流正则化约束运动轨迹
- 在Hi4D和CMU Panoptic上分别提升49%和19%的精度
- 无需预设物体数量类型,适合复杂动态场景
本文针对基于高斯点阵(Gaussian Splatting, GS)的动态场景表面重建问题,提出一种统一的4DSurf框架,无需预先指定场景中物体的数量或类型,可有效处理大尺度表面形变与重建时序不一致问题。核心创新在于引入由高斯变形驱动的符号距离函数流正则化,约束高斯点的运动与表面演化对齐。为应对大形变,设计重叠分段策略,将序列划分为具有小形变的重叠段,并通过共享时间步逐段传递几何信息。在两个挑战性动态场景数据集Hi4D和CMU Panoptic上的实验表明,该方法在切比雪夫距离(Chamfer distance)上分别优于当前最优方法49%和19%,并在稀疏视角条件下实现了更优的时序一致性。
原文摘要 · Abstract (English)
This paper addresses the problem of dynamic scene surface reconstruction using Gaussian Splatting (GS), aiming to recover temporally consistent geometry. While existing GS-based dynamic surface reconstruction methods can yield superior reconstruction, they are typically limited to either a single object or objects with only small deformations, struggling to maintain temporally consistent surface reconstruction of large deformations over time. We propose ``\textit{4DSurf}'', a novel and unified framework for generic dynamic surface reconstruction that does not require specifying the number or types of objects in the scene, can handle large surface deformations and temporal inconsistency in reconstruction. The key innovation of our framework is the introduction of Gaussian deformations induced Signed Distance Function Flow Regularization that constrains the motion of Gaussians to align with the evolving surface. To handle large deformations, we introduce an Overlapping Segment Partitioning strategy that divides the sequence into overlapping segments with small deformations and incrementally passes geometric information across segments through the shared overlapping timestep. Experiments on two challenging dynamic scene datasets, Hi4D and CMU Panoptic, demonstrate that our method outperforms state-of-the-art surface reconstruction methods by 49\% and 19\% in Chamfer distance, respectively, and achieves superior temporal consistency under sparse-view settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。