arXiv:2412.00333cs.CV2024-12被引 1

用瓦斯蒂·几何约束动态高斯点云,让物体运动更自然流畅。

Gaussians on their Way: Wasserstein-Constrained 4D Gaussian Splatting with State-Space Modeling

  • 引入状态一致性滤波器融合预测与观测,保持高斯点随时间一致
  • 通过瓦斯蒂距离正则化实现参数平滑更新,减少运动伪影
  • 结合瓦斯蒂几何建模形变与移动,适合真实动态场景重建

动态场景渲染因4D高斯点云技术取得突破性进展,但仍面临如何使3D高斯点在时间上自然运动的挑战。本文提出一种融合状态空间建模与瓦斯蒂几何的新方法,引导高斯点在瓦斯蒂空间中沿其自然轨迹演化。设计状态一致性滤波器,融合先验预测与当前观测,确保高斯点随时间保持一致性。采用瓦斯蒂距离正则化,实现高斯参数的平滑、一致更新,有效降低运动伪影。同时利用瓦斯蒂几何捕捉平移运动与形状形变,构建更符合物理规律的动态场景模型。实验表明,该方法显著提升渲染质量与效率,优于现有最先进方法。

原文摘要 · Abstract (English)

Dynamic scene rendering has taken a leap forward with the rise of 4D Gaussian Splatting, but there's still one elusive challenge: how to make 3D Gaussians move through time as naturally as they would in the real world, all while keeping the motion smooth and consistent. In this paper, we unveil a fresh approach that blends state-space modeling with Wasserstein geometry, paving the way for a more fluid and coherent representation of dynamic scenes. We introduce a State Consistency Filter that merges prior predictions with the current observations, enabling Gaussians to stay true to their way over time. We also employ Wasserstein distance regularization to ensure smooth, consistent updates of Gaussian parameters, reducing motion artifacts. Lastly, we leverage Wasserstein geometry to capture both translational motion and shape deformations, creating a more physically plausible model for dynamic scenes. Our approach guides Gaussians along their natural way in the Wasserstein space, achieving smoother, more realistic motion and stronger temporal coherence. Experimental results show significant improvements in rendering quality and efficiency, outperforming current state-of-the-art techniques.

4D高斯动态渲染瓦斯蒂几何状态空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。