arXiv:2512.04815cs.CV2025-12被引 3

解决真实场景3D高斯溅射中动态物体与光照干扰导致的渲染瑕疵问题。

RobustSplat++: Decoupling Densification, Dynamics, and Illumination for In-the-Wild 3DGS

  • 延迟生长策略:先优化静态结构,再分裂高斯点,避免过拟合动态物体。
  • 多尺度掩码自举:从低分辨率到高分辨率逐步精准定位动态区域。
  • 融合光照建模与动态分离,显著提升复杂环境下的重建鲁棒性。

3D高斯溅射(3DGS)因其实时、逼真的新视角合成能力受到广泛关注。然而,现有方法在应对受瞬时物体和光照变化影响的真实场景时,常产生渲染伪影。我们发现,高斯点密集化过程虽能增强细节捕捉,却也无意中生成了描述瞬时扰动和光照变化的额外高斯点,导致伪影。为此,我们提出RobustSplat++,采用三项关键设计:首先,引入延迟高斯生长策略,在早期优化中优先稳定静态结构,防止对瞬时物体过拟合;其次,设计多尺度掩码自举方法,先利用低分辨率特征相似性监督进行可靠的初始动态掩码估计(依赖更强语义一致性与抗噪性),再逐步过渡至高分辨率监督以实现更精确预测;最后,将延迟生长与掩码自举结合外观建模,有效处理包含瞬时对象和光照变化的真实场景。在多个挑战性数据集上的大量实验表明,本方法显著优于现有方法,充分验证其鲁棒性与有效性。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling. However, existing methods struggle with accurately modeling in-the-wild scenes affected by transient objects and illuminations, leading to artifacts in the rendered images. We identify that the Gaussian densification process, while enhancing scene detail capture, unintentionally contributes to these artifacts by growing additional Gaussians that model transient disturbances and illumination variations. To address this, we propose RobustSplat++, a robust solution based on several critical designs. First, we introduce a delayed Gaussian growth strategy that prioritizes optimizing static scene structure before allowing Gaussian splitting/cloning, mitigating overfitting to transient objects in early optimization. Second, we design a scale-cascaded mask bootstrapping approach that first leverages lower-resolution feature similarity supervision for reliable initial transient mask estimation, taking advantage of its stronger semantic consistency and robustness to noise, and then progresses to high-resolution supervision to achieve more precise mask prediction. Third, we incorporate the delayed Gaussian growth strategy and mask bootstrapping with appearance modeling to handling in-the-wild scenes including transients and illuminations. Extensive experiments on multiple challenging datasets show that our method outperforms existing methods, clearly demonstrating the robustness and effectiveness of our method.

3D高斯动态建模鲁棒重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。