无需训练即可过滤3D高斯溅射中的干扰物,提升新视角质量。
Per-View Gaussian Predictions Enable Training-Free Distractor Filtering in Feed-Forward 3DGS

- 利用每视图独有高斯预测,通过对比其他视图验证异常内容
- 在不同输入视角数下均显著减少模糊、重复和漂浮伪影
- 适配任意冻结模型,无需重训练或场景微调
前馈式3D高斯溅射可在单次网络执行中从多张输入图像重建显式高斯表示,使普通拍摄的3D重建更易实现。然而,此类拍摄常包含仅出现在部分视图中的瞬时物体。这些内容可能被编码进观测到它的输入对应的每视图高斯中,并残留在最终组合表示中,导致新视角出现模糊、重复或漂浮伪影。本文提出一种无需训练的过滤流程,利用每视图预测结构:对每个输入,移除其关联高斯后用其余表示渲染相同相机视角,识别与其他输入不一致的内容。基于特征相似性生成候选区域,再通过渲染验证保留那些移除后能降低其他输入视图重建误差的候选。该方法在单个冻结预测上运行,无需重训练或场景特定优化。在三种重建模型和两个干扰物基准上,无论输入视图数量如何,均持续提升新视角质量;在干净场景中,四种模型评估显示原始重建基本保持不变。
原文摘要 · Abstract (English)
Feed-forward 3D Gaussian Splatting reconstructs an explicit Gaussian representation from multiple input images in one network execution, making 3D reconstruction increasingly accessible for casual captures. However, such captures frequently contain transient objects that appear in only a subset of the views. Such content can be encoded into the per-view Gaussians associated with the inputs that observe it and remain in the combined representation despite being observed by no other input. As a result, it may produce blurred, duplicated, or floating artifacts in novel views. We introduce a training-free filtering procedure that exploits this per-view prediction structure. For each input, we exclude its associated Gaussians and render the same camera using the remaining representation, revealing content that is inconsistent with the other inputs. Feature similarity forms candidate regions, and rendering-based verification retains only candidates whose removal reduces reconstruction error in the other input views. The procedure operates on a single frozen prediction without retraining or scene-specific optimization. Across three reconstruction models and two distractor benchmarks, it consistently improves novel-view quality with varying numbers of input views. On clean scenes, evaluations across four models show that the original reconstructions are largely preserved.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。