arXiv:2505.22400cs.GRcs.CV2025-05被引 6

分离时空特征,提升动态场景实时渲染一致性

STDR: Spatio-Temporal Decoupling for Real-Time Dynamic Scene Rendering

  • 为每个高斯点学习时空概率分布,解耦空间与时间模式
  • 在合成与真实数据上显著改善重建质量与时空一致性
  • 可插拔模块,适配现有3DGS动态重建框架

尽管动态场景重建一直是3D视觉中的基础挑战,但近年来基于3D高斯溅射(3DGS)的方法通过显式高斯原语实现了高质量、实时渲染。然而,现有基于3DGS的动态重建方法在初始化阶段常存在时空不一致问题,即通过聚合多帧观测构建基准高斯点,缺乏时间区分,导致空间与时间特征纠缠,难以准确建模动态运动。为此,我们提出STDR(Spatio-Temporal Decoupling for Real-time rendering),一个可插拔模块,通过学习每个高斯点的时空概率分布,引入时空掩码、独立形变场和一致性正则化,联合解耦空间与时间模式。大量实验表明,将该模块集成到现有3DGS动态场景重建框架中,可在合成与真实世界基准上显著提升重建质量和时空一致性。

原文摘要 · Abstract (English)

Although dynamic scene reconstruction has long been a fundamental challenge in 3D vision, the recent emergence of 3D Gaussian Splatting (3DGS) offers a promising direction by enabling high-quality, real-time rendering through explicit Gaussian primitives. However, existing 3DGS-based methods for dynamic reconstruction often suffer from \textit{spatio-temporal incoherence} during initialization, where canonical Gaussians are constructed by aggregating observations from multiple frames without temporal distinction. This results in spatio-temporally entangled representations, making it difficult to model dynamic motion accurately. To overcome this limitation, we propose \textbf{STDR} (Spatio-Temporal Decoupling for Real-time rendering), a plug-and-play module that learns spatio-temporal probability distributions for each Gaussian. STDR introduces a spatio-temporal mask, a separated deformation field, and a consistency regularization to jointly disentangle spatial and temporal patterns. Extensive experiments demonstrate that incorporating our module into existing 3DGS-based dynamic scene reconstruction frameworks leads to notable improvements in both reconstruction quality and spatio-temporal consistency across synthetic and real-world benchmarks.

3D重建动态场景高斯溅射时空解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。