arXiv:2507.08434cs.CV2025-07

用参考视图指导3D场景修复,让多视角看起来更一致真实。

RePaintGS: Reference-Guided Gaussian Splatting for Realistic and View-Consistent 3D Scene Inpainting

  • 以参考视图为基准,动态调整其他视角的贡献
  • 修复后场景几何更准,跨视角外观一致性提升
  • 适合需要多视角一致性的3D内容重建任务

基于辐射场的3D表示(如神经辐射场或3D高斯点阵)已成为生成逼真新视角的核心方法。在实际应用中,灵活的场景编辑技术备受关注,其中物体移除是典型任务。但移除物体后会暴露被遮挡区域,常导致不自然的视觉效果。已有研究采用图像修复技术填补这些区域,即3D场景修复任务。然而,图像修复方法对每个视角只能生成一种可能的补全结果,导致不同视角间不一致。现有方法依赖感知线索实现视角间平滑融合,但易丢失细节,且在视角间感知不一致时失效。本文提出一种新型3D场景修复方法,通过引入参考视图,可靠生成既真实又视角一致的结果。给定修复后的参考视图,我们计算其他视角的修复相似性,据此调整其在构建精准几何中的权重。该几何用于将参考视图的修复内容伪地投射到其他视角,作为伪真实标签,引导优化过程匹配参考视图的外观。对比实验表明,本方法显著提升了修复场景的几何保真度和外观一致性。

原文摘要 · Abstract (English)

Radiance field methods, such as Neural Radiance Field or 3D Gaussian Splatting, have emerged as seminal 3D representations for synthesizing realistic novel views. For practical applications, there is ongoing research on flexible scene editing techniques, among which object removal is a representative task. However, removing objects exposes occluded regions, often leading to unnatural appearances. Thus, studies have employed image inpainting techniques to replace such regions with plausible content - a task referred to as 3D scene inpainting. However, image inpainting methods produce one of many plausible completions for each view, leading to inconsistencies between viewpoints. A widely adopted approach leverages perceptual cues to blend inpainted views smoothly. However, it is prone to detail loss and can fail when there are perceptual inconsistencies across views. In this paper, we propose a novel 3D scene inpainting method that reliably produces realistic and perceptually consistent results even for complex scenes by leveraging a reference view. Given the inpainted reference view, we estimate the inpainting similarity of the other views to adjust their contribution in constructing an accurate geometry tailored to the reference. This geometry is then used to warp the reference inpainting to other views as pseudo-ground truth, guiding the optimization to match the reference appearance. Comparative evaluation studies have shown that our approach improves both the geometric fidelity and appearance consistency of inpainted scenes.

3D修复高斯点阵视图一致参考引导

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。