融合几何、颜色与高斯信息,实现低重叠场景下精准点云配准。
GeGS-PCR: Effective and Robust 3D Point Cloud Registration with Two-Stage Color-Enhanced Geometric-3DGS Fusion

- 分两阶段融合几何、颜色与3D高斯信息,增强特征表达
- 在极低重叠下实现99.9%配准召回率,旋转误差仅0.013
- 适合复杂场景下的点云配准,尤其适用于弱纹理区域
针对依赖几何特征的传统点云配准方法在低重叠和不完整场景中表现不佳的问题,本文提出GeGS-PCR,一种结合几何、颜色与高斯信息的两阶段鲁棒配准方法。通过专用颜色编码器提取多层级几何与颜色特征,并引入几何-3DGS模块,编码带颜色的超点局部邻域信息,构建全局不变的几何-颜色上下文。借助LORA优化,在保持3DGS表达能力的同时提升效率。采用可微渲染加速配准收敛,并设计联合光度损失,同时利用几何与颜色特征。在自动生成的ColorKitti数据集及Color3DMatch、Color3DLoMatch上验证,本方法达到99.9%的注册召回率,相对旋转误差低至0.013,相对平移误差低至0.024,精度提升至少2倍。
原文摘要 · Abstract (English)
We address the challenge of point cloud registration using color information, where traditional methods relying solely on geometric features often struggle in low-overlap and incomplete scenarios. To overcome these limitations, we propose GeGS-PCR, a novel two-stage method that combines geometric, color, and Gaussian information for robust registration. Our approach incorporates a dedicated color encoder that enhances color features by extracting multi-level geometric and color data from the original point cloud. We introduce the \textbf{Ge}ometric-3D\textbf{GS} module, which encodes the local neighborhood information of colored superpoints to ensure a globally invariant geometric-color context. Leveraging LORA optimization, we maintain high performance while preserving the expressiveness of 3DGS. Additionally, fast differentiable rendering is utilized to refine the registration process, leading to improved convergence. To further enhance performance, we propose a joint photometric loss that exploits both geometric and color features. This enables strong performance in challenging conditions with extremely low point cloud overlap. We validate our method by colorizing the Kitti dataset as ColorKitti and testing on both Color3DMatch and Color3DLoMatch datasets. Our method achieves state-of-the-art performance with \textit{Registration Recall} at 99.9\%, \textit{Relative Rotation Error} as low as 0.013, and \textit{Relative Translation Error} as low as 0.024, improving precision by at least a factor of 2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。