无需标注,自动清除3D高斯点云中的屏幕伪影
SSA-3DGS: Unsupervised Removal of Screen-Space Artifacts for 3D Gaussian Splatting

- 通过联合优化3D场景与可学习2D图层,分离静态伪影
- 在真实数据上提升9分贝的重建质量,优于原始3DGS
- 适合处理带镜头遮挡、水印等伪影的视频重建
新视角合成方法如3D高斯点云(3DGS)依赖于干净且多视角一致的输入图像。但真实采集常因屏幕空间伪影——如传感器缺陷、雨雪遮挡、手指遮挡或数字水印——违反此假设。这些伪影被错误地嵌入3D几何中形成‘漂浮物’,降低新视角渲染质量。本文提出无监督框架SSA-3DGS,联合优化3D场景与可学习2D图层,利用多视角几何一致性,将静态伪影从3D结构中解耦,无需人工标注或干预。在多种合成伪影和自采真实数据集上,相比在相同污染输入下训练的3DGS,SSA-3DGS提升重建保真度高达9 dB PSNR,同时完整保留原始伪影。
原文摘要 · Abstract (English)
Novel View Synthesis (NVS) methods, such as 3D Gaussian Splatting (3DGS), rely heavily on the assumption of clean, multi-view consistent, posed input images. Real-world captures can violate this assumption due to screen-space artifacts-static occlusions fixed to the 2D image plane rather than to the 3D world. Common examples include physical sensor defects, environmental obstructions (such as rain or mud on the lens enclosure), capture obstructions (such as a thumb over the camera sensor or a dashboard visible in dashcam footage), and digital overlays (such as watermarks or UI elements). When present, they are erroneously baked into the 3D geometry as "floaters" or near-camera artifacts, degrading the quality of novel-view rendering. In this work, we propose SSA-3DGS, an unsupervised framework that jointly optimizes a 3D scene and a learnable 2D overlay to recover a clean 3D scene and the corrupting artifacts. By exploiting geometric consensus across views, our method effectively disentangles static artifacts from the 3D scene geometry without supervision or manual input. Across diverse synthetic corruptions and a self-captured real-world dataset, SSA-3DGS improves reconstruction fidelity by up to 9 dB PSNR over 3DGS trained on the same corrupted inputs, while faithfully preserving the corrupting artifact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。