arXiv:2604.21631cs.CV2026-04中稿 · CVPR被引 1

用重建失败生成伪掩码,让3D高斯溅射更抗动态物体干扰

DualSplat: Robust 3D Gaussian Splatting via Pseudo-Mask Bootstrapping from Reconstruction Failures

论文配图:DualSplat: Robust 3D Gaussian Splatting via Pseudo-Mask Bootstrapping from Reconstruction Failures
图 1 · 摘自论文原文
  • 从首次重建失败中提取动态物体检出信号,生成物体级伪掩码
  • 在含大量动态物体的场景中,渲染质量显著优于现有方法
  • 适合需要稳定处理动态场景的实时3D重建应用

尽管3D高斯溅射(3DGS)能实现实时逼真渲染,但在训练图像包含违反多视角一致性的瞬态物体时性能明显下降。现有方法面临循环依赖:准确检测瞬态物体需要良好重建的静态场景,而干净重建又依赖可靠的瞬态掩码。本文提出DualSplat,一种从重建失败中获取先验的失败-先验框架。我们观察到,仅出现在部分视角的瞬态物体,在保守初始训练中常表现为不完整碎片。通过结合光度残差、特征不匹配和SAM2实例边界,将这些失败转化为对象级伪掩码。这些伪掩码指导第二次清洁重建,同时一个轻量级MLP在线优化掩码,逐步从先验监督转向自洽性。在RobustNeRF和NeRF On-the-go数据集上的实验表明,DualSplat优于现有基线,尤其在动态物体密集场景及区域表现突出。

原文摘要 · Abstract (English)

While 3D Gaussian Splatting (3DGS) achieves real-time photorealistic rendering, its performance degrades significantly when training images contain transient objects that violate multi-view consistency. Existing methods face a circular dependency: accurate transient detection requires a well-reconstructed static scene, while clean reconstruction itself depends on reliable transient masks. We address this challenge with DualSplat, a Failure-to-Prior framework that converts first-pass reconstruction failures into explicit priors for a second reconstruction stage. We observe that transients, which appear in only a subset of views, often manifest as incomplete fragments during conservative initial training. We exploit these failures to construct object-level pseudo-masks by combining photometric residuals, feature mismatches, and SAM2 instance boundaries. These pseudo-masks then guide a clean second-pass 3DGS optimization, while a lightweight MLP refines them online by gradually shifting from prior supervision to self-consistency. Experiments on RobustNeRF and NeRF On-the-go show that DualSplat outperforms existing baselines, demonstrating particularly clear advantages in transient-heavy scenes and transient regions.

3D重建动态物体高斯溅射伪掩码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。