arXiv:2509.19937cs.CV2025-09SIGGRAPH被引 5

用3D高斯表示法在驾驶场景中直接替换缺失区域,无需重训练。

GS-RoadPatching: Inpainting Gaussians via 3D Searching and Placing for Driving Scenes

  • 通过3D空间搜索匹配相似结构块,实现基于3DGS的替换式修复。
  • 在多个数据集上达到当前最佳效果,且推理效率高。
  • 适合需要快速修复驾驶场景的自动驾驶与地图重建应用。

本文提出GS-RoadPatching,一种基于3D高斯泼溅(3DGS)的驾驶场景补全方法,利用完全重建区域作为参考进行修复。不同于现有3DGS修复方法依赖2D视角扩散或GAN模型生成有限外观或深度线索,本方法直接在3DGS模态下实现替换式场景修复,摆脱对2D跨模态时空一致性的要求,并避免高成本的高斯重训练。核心思想是驾驶场景中常存在高度重复的模式,在隐式3DGS特征空间内具有多模态相似性,适合用于结构匹配以实现有效的3DGS替换修复。实际中,我们构建带特征嵌入的3DGS场景,引入多尺度局部上下文抽象的补丁度量方法,并提出一种高效的结构搜索策略定位候选补丁;最后设计简单的替换-融合优化算法提升视觉一致性。在多个公开数据集上的实验验证了该方法在质量与互操作性方面的先进性能,且在通用场景中也表现出良好适用性。项目主页与代码已开源。

原文摘要 · Abstract (English)

This paper presents GS-RoadPatching, an inpainting method for driving scene completion by referring to completely reconstructed regions, which are represented by 3D Gaussian Splatting (3DGS). Unlike existing 3DGS inpainting methods that perform generative completion relying on 2D perspective-view-based diffusion or GAN models to predict limited appearance or depth cues for missing regions, our approach enables substitutional scene inpainting and editing directly through the 3DGS modality, extricating it from requiring spatial-temporal consistency of 2D cross-modals and eliminating the need for time-intensive retraining of Gaussians. Our key insight is that the highly repetitive patterns in driving scenes often share multi-modal similarities within the implicit 3DGS feature space and are particularly suitable for structural matching to enable effective 3DGS-based substitutional inpainting. Practically, we construct feature-embedded 3DGS scenes to incorporate a patch measurement method for abstracting local context at different scales and, subsequently, propose a structural search method to find candidate patches in 3D space effectively. Finally, we propose a simple yet effective substitution-and-fusion optimization for better visual harmony. We conduct extensive experiments on multiple publicly available datasets to demonstrate the effectiveness and efficiency of our proposed method in driving scenes, and the results validate that our method achieves state-of-the-art performance compared to the baseline methods in terms of both quality and interoperability. Additional experiments in general scenes also demonstrate the applicability of the proposed 3D inpainting strategy. The project page and code are available at: https://shanzhaguoo.github.io/GS-RoadPatching/

3D修复高斯泼溅自动驾驶图像补全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。