用3D场景图提升3D高斯点云拼接精度,解决合并后的空洞和浮点问题。
Graph-GSReg: Leveraging 3D Scene Graphs for Gaussian Splatting Registration

- 将3D高斯点云拼接转化为场景图注册问题,利用语义与结构信息提升一致性。
- 在真实与合成数据上实现高精度拼接,合并后图像质量优于现有方法。
- 引入自监督测试时优化,有效减少拼接带来的空洞和浮点瑕疵,适合大规模建图。
将多个3D高斯点云(3DGS)场景合并为统一的高斯表示,对大规模3D建图和长期地图管理至关重要。尽管重要,该领域仍研究不足,现有方法存在诸多局限:基于学习的方法需在大型3DGS数据集上训练,直接建立高斯原语间的对应关系;基于图像的优化方法严重依赖通用基础模型提供的粗初始化,且常伴随昂贵的精细化过程。本文提出 extit{Graph-GSReg},通过从3DGS及其渲染图像构建3D场景图,将3DGS拼接问题重新定义为图注册问题。该3D场景图以更高层次表征每个3DGS,实现了对语义信息和结构上下文的全局一致理解,从而支持更精准的拼接。为实现无缝统一场景,进一步引入自监督测试时优化(Self-Supervised Test-Time Optimization)。直接拼接两个3D高斯场景常导致遮挡伪影,如空洞和浮点现象。为此,我们对合并后的高斯进行优化,以保持原始场景与合并场景之间的视觉一致性。我们在真实与合成基准上评估了该方法,结果表明其在拼接精度和合并场景渲染质量方面均达到竞争力水平。
原文摘要 · Abstract (English)
Merging multiple 3D Gaussian Splatting (3DGS) scenes into a single unified Gaussian representation is essential for large-scale 3D mapping and long-term map management. Despite its importance, this area remains underexplored, and existing solutions exhibit several limitations. Learning-based methods attempt direct correspondence between Gaussian primitives and require training on large 3DGS datasets. Image-based optimization methods depend heavily on coarse initialization from generic foundation models and often incur expensive refinement. We present \ourmodel. Our method constructs a 3D scene graph from a 3DGS and its rendered images, \textit{reformulating 3DGS registration as a graph registration problem}. The proposed 3D scene graph represents each 3DGS at a higher-level representation, enabling a globally consistent understanding of semantic information and structural context for accurate registration. To further construct a seamless unified scene, we introduce a Self-Supervised Test-Time Optimization. Naively merging two 3D Gaussian scenes often suffers from occlusion artifacts such as hollows and floaters. To alleviate this issue, we refine the merged Gaussians to preserve visual consistency between the original scenes and the merged scene. We evaluate our method on real and synthetic benchmarks, demonstrating competitive registration accuracy and merged scene rendering quality.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。