通过射线分组约束动态高斯点云的局部几何,提升视频重建的物理合理性。
Relaxed Rigidity with Ray-based Grouping for Dynamic Gaussian Splatting
- 用射线分组聚类交于同射线的高斯点,仅保留透明度权重高的点
- 在多个单目数据集上实现更优的时间一致性与重建质量
- 无需外部光流或2D轨迹,适合缺乏先验信息的动态场景重建
基于3D高斯点云的动态三维场景重建展现出巨大潜力。然而,现有方法难以真实建模运动,多数无法使高斯点运动符合物理规律。这种偏差在单目视频数据集上尤为严重,导致局部几何结构失真,最终降低重建质量。因此,许多先进方法依赖外部先验(如光流或2D轨迹)来维持时间连贯性。本文提出一种新方法,显式保持4D场景中高斯点的局部几何结构。核心思想是引入视空间射线分组策略:将被同一射线穿过的高斯点聚类,仅保留α-混合权重超过阈值的点,并对这些组施加约束以维持其空间分布的一致性,从而稳定局部几何。该方法通过强制运动符合物理合理性,避免依赖外部引导。我们将该方法集成到两个不同基线模型中,在多个挑战性单目数据集上进行了大量实验,结果表明本方法显著优于现有方法,实现了更优的时间一致性和重建质量。
原文摘要 · Abstract (English)
The reconstruction of dynamic 3D scenes using 3D Gaussian Splatting has shown significant promise. A key challenge, however, remains in modeling realistic motion, as most methods fail to align the motion of Gaussians with real-world physical dynamics. This misalignment is particularly problematic for monocular video datasets, where failing to maintain coherent motion undermines local geometric structure, ultimately leading to degraded reconstruction quality. Consequently, many state-of-the-art approaches rely heavily on external priors, such as optical flow or 2D tracks, to enforce temporal coherence. In this work, we propose a novel method to explicitly preserve the local geometric structure of Gaussians across time in 4D scenes. Our core idea is to introduce a view-space ray grouping strategy that clusters Gaussians intersected by the same ray, considering only those whose $α$-blending weights exceed a threshold. We then apply constraints to these groups to maintain a consistent spatial distribution, effectively preserving their local geometry. This approach enforces a more physically plausible motion model by ensuring that local geometry remains stable over time, eliminating the reliance on external guidance. We demonstrate the efficacy of our method by integrating it into two distinct baseline models. Extensive experiments on challenging monocular datasets show that our approach significantly outperforms existing methods, achieving superior temporal consistency and reconstruction quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。