arXiv:2506.02751cs.CV2025-06ICCV被引 16

解决3D高斯渲染中瞬态物体导致的图像伪影问题

RobustSplat: Decoupling Densification and Dynamics for Transient-Free 3DGS

  • 延迟增长高斯点,先优化静态结构再细化细节
  • 分层掩码引导:低分辨率先定性,高分辨率再精确
  • 适合动态场景重建,提升真实感渲染质量

3D高斯点阵(3DGS)在新视角合成与三维建模中实现了实时、逼真的渲染,但现有方法在存在瞬态物体的场景中表现不佳,导致渲染图像出现伪影。本文发现,高斯点密集化过程虽能增强细节捕捉,却会无意中生成模拟瞬态干扰的额外高斯点,从而引入伪影。为此,提出RobustSplat,包含两项关键设计:首先采用延迟生长策略,在早期优化阶段优先聚焦静态场景结构,避免对瞬态物体过拟合;其次设计分层级掩码自举方法,先利用低分辨率特征相似性监督进行可靠初始瞬态掩码估计(得益于更强语义一致性与抗噪能力),再逐步过渡到高分辨率监督以实现更精确的掩码预测。在多个挑战性数据集上的大量实验表明,该方法显著优于现有方法,充分验证了其鲁棒性与有效性。

原文摘要 · Abstract (English)

3D Gaussian Splatting (3DGS) has gained significant attention for its real-time, photo-realistic rendering in novel-view synthesis and 3D modeling. However, existing methods struggle with accurately modeling scenes affected by transient objects, leading to artifacts in the rendered images. We identify that the Gaussian densification process, while enhancing scene detail capture, unintentionally contributes to these artifacts by growing additional Gaussians that model transient disturbances. To address this, we propose RobustSplat, a robust solution based on two critical designs. First, we introduce a delayed Gaussian growth strategy that prioritizes optimizing static scene structure before allowing Gaussian splitting/cloning, mitigating overfitting to transient objects in early optimization. Second, we design a scale-cascaded mask bootstrapping approach that first leverages lower-resolution feature similarity supervision for reliable initial transient mask estimation, taking advantage of its stronger semantic consistency and robustness to noise, and then progresses to high-resolution supervision to achieve more precise mask prediction. Extensive experiments on multiple challenging datasets show that our method outperforms existing methods, clearly demonstrating the robustness and effectiveness of our method. Our project page is https://fcyycf.github.io/RobustSplat/.

3D高斯图像修复动态场景

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。