解决动态环境下3D高斯溅射的漂浮伪影问题
MVGSR: Multi-View Consistency Gaussian Splatting for Robust Surface Reconstruction
- 通过多视角特征一致性识别并分离动态干扰物
- 早期训练即获得精确遮挡掩码,减少颜色错误
- 适合复杂动态场景下的鲁棒表面重建
3D高斯溅射(3DGS)因其高质量渲染、极快训练与推理速度而受到关注。但在动态物体和干扰物存在的环境中进行表面重建时,该方法因多视角不一致导致漂浮伪影和颜色错误。为此,我们提出面向鲁棒表面重建的多视角一致性高斯溅射(MVGSR),利用轻量级高斯模型和启发式引导的干扰物掩码策略,在非静态环境中实现稳定重建。相比依赖MLP进行干扰物分割的方法,MVGSR通过比较多视角特征一致性,提前分离动态物体与静态场景元素,获得精确干扰物掩码。此外,基于多视角贡献的剪枝机制重置透明度,有效降低漂浮伪影。最后,引入多视角一致性损失,提升表面重建质量。实验表明,MVGSR在几何精度和渲染保真度上均达到当前最优水平。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has gained significant attention for its high-quality rendering capabilities, ultra-fast training, and inference speeds. However, when we apply 3DGS to surface reconstruction tasks, especially in environments with dynamic objects and distractors, the method suffers from floating artifacts and color errors due to inconsistency from different viewpoints. To address this challenge, we propose Multi-View Consistency Gaussian Splatting for the domain of Robust Surface Reconstruction (\textbf{MVGSR}), which takes advantage of lightweight Gaussian models and a {heuristics-guided distractor masking} strategy for robust surface reconstruction in non-static environments. Compared to existing methods that rely on MLPs for distractor segmentation strategies, our approach separates distractors from static scene elements by comparing multi-view feature consistency, allowing us to obtain precise distractor masks early in training. Furthermore, we introduce a pruning measure based on multi-view contributions to reset transmittance, effectively reducing floating artifacts. Finally, a multi-view consistency loss is applied to achieve high-quality performance in surface reconstruction tasks. Experimental results demonstrate that MVGSR achieves competitive geometric accuracy and rendering fidelity compared to the state-of-the-art surface reconstruction algorithms. More information is available on our project page (https://mvgsr.github.io).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。