arXiv:2608.31023cs.CV2026-08

用语义运动图约束单目动态高斯点云,提升复杂场景重建效果

SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting

论文配图:SMG: Semantic Motion Graph for Monocular Dynamic Gaussian Splatting
图 1 · 摘自论文原文
  • 将高斯点运动建模为低秩语义运动图,利用语义一致性先验
  • 在真实世界挑战性数据集上实现当前最优的单目动态重建性能
  • 适合做动态场景三维重建的研究者和开发者参考

我们研究从单目视频中进行动态高斯点云建模。尽管近期动态高斯点云进展为动态场景建模提供了良好基础,但其常因缺乏可靠正则化信号而在欠约束区域过拟合,导致在遮挡或复杂运动下失效。为此,我们提出语义运动图(Semantic Motion Graph, SMG),将高斯点运动建模为低秩语义运动。核心洞察是:真实场景中的运动通常具有语义一致性——空间相近且语义相关的区域往往表现出一致的动力学特征。通过构建SMG来建模这种结构化运动,高斯点运动由图节点驱动。我们进一步发现,高斯点运动的不确定性源于不可靠的现成先验与优化过程中的弱约束区域。SMG通过使用可靠的图节点引导附近不可靠节点的运动来缓解此问题。为评估在真实世界复杂场景下的动态高斯点云表现,我们引入一个基于自内向外(ego-exo)设置的新多视角数据集。大量实验表明,SMG在多个具有挑战性的真实世界基准上实现了当前最优性能。

原文摘要 · Abstract (English)

We study dynamic Gaussian Splatting from monocular videos. While recent advancements in dynamic Gaussian splatting offer a promising foundation for modeling dynamic scenes, they often overfit to the training views and fail under occlusion or complex scene motion due to the lack of reliable regularization signals in under-constrained regions. We propose Semantic Motion Graph (SMG), a novel approach models the Gaussian motion as the low-rank semantic motion. Our key insight is that the real-world scene motion is often structured by semantic coherence: regions that are spatially close and semantically related tend to exhibit consistent dynamics. To leverage this prior, we construct SMG to model structured motion of the scene. The Gaussian motion is driven by the motion of SMG nodes. We further observe that the uncertainty of Gaussian motion arises from both unreliable off-the-shelf priors and weakly constrained regions during optimization. SMG addresses this by using reliable graph nodes to guide the motion of nearby unreliable nodes. To evaluate dynamic Gaussian splatting under challenging real-world scenarios, we introduce a new multiview dataset collected under an ego-exo setup. Extensive experiments demonstrate that SMG achieves state-of-the-art performance on monocular dynamic Gaussian splatting across challenging real-world benchmarks. Project page: https://smg-gaussian.github.io/.

动态重建高斯点云语义建模单目视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。