arXiv:2603.25042cs.CV2026-03被引 1

让3D高斯点自主学习真实运动,提升动态场景重建精度

MoRGS: Efficient Per-Gaussian Motion Reasoning for Streamable Dynamic 3D Scenes

  • 用稀疏关键帧光流做轻量运动引导,约束每个高斯点的运动
  • 通过运动偏移场补偿视角差异,实现跨时间与视图的运动一致性
  • 引入运动置信度区分动静,加速大运动建模并减少静态区域噪声

在线动态场景重建需在低延迟下处理多视角流数据。尽管3D高斯喷溅具备快速训练与实时渲染能力,使在线4D重建成为可能,但现有方法未能显式建模每个高斯点的运动,导致其仅依赖光度损失优化,使运动追逐像素残差而非真实3D运动。为此,我们提出MoRGS,一种高效的在线逐高斯运动推理框架。通过在稀疏关键帧上使用光流作为轻量运动提示,对每个高斯点的运动进行超参数监督。为弥补光流稀疏性,我们学习一个逐高斯运动偏移场,以协调投影3D运动与观测光流间的差异。同时引入逐高斯运动置信度,分离动态与静态高斯点,并加权属性残差更新,抑制静态区域冗余运动,增强时间一致性并加速大运动建模。大量实验表明,MoRGS在在线方法中达到最先进的重建质量与运动保真度,且保持可流式处理性能。

原文摘要 · Abstract (English)

Online reconstruction of dynamic scenes aims to learn from streaming multi-view inputs under low-latency constraints. The fast training and real-time rendering capabilities of 3D Gaussian Splatting have made on-the-fly reconstruction practically feasible, enabling online 4D reconstruction. However, existing online approaches, despite their efficiency and visual quality, fail to learn per-Gaussian motion that reflects true scene dynamics. Without explicit motion cues, appearance and motion are optimized solely under photometric loss, causing per-Gaussian motion to chase pixel residuals rather than true 3D motion. To address this, we propose MoRGS, an efficient online per-Gaussian motion reasoning framework that explicitly models per-Gaussian motion to improve 4D reconstruction quality. Specifically, we leverage optical flow on a sparse set of key views as lightweight motion cues that regularize per-Gaussian motion beyond photometric supervision. To compensate for the sparsity of flow supervision, we learn a per-Gaussian motion offset field that reconciles discrepancies between projected 3D motion and observed flow across views and time. In addition, we introduce a per-Gaussian motion confidence that separates dynamic from static Gaussians and weights Gaussian attribute residual updates, thereby suppressing redundant motion in static regions for better temporal consistency and accelerating the modeling of large motions. Extensive experiments demonstrate that MoRGS achieves state-of-the-art reconstruction quality and motion fidelity among online methods, while maintaining streamable performance.

3D重建动态场景高斯喷溅运动建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。