用激光雷达反射率引导高亮点云,提升自动驾驶场景重建质量
LR-SGS: Robust LiDAR-Reflectance-Guided Salient Gaussian Splatting for Self-Driving Scene Reconstruction
- 基于激光雷达几何与反射率特征初始化高亮点云,增强结构感知
- 在复杂光照下比OmniRe高1.18 dB PSNR,仅用更少点数和更短训练时间
- 适合自动驾驶场景的高质量3D重建,尤其对边缘和平面结构敏感
近期3D高斯溅射(3DGS)方法已证明自驾车场景重建与新视角合成的可行性。但多数方法仅依赖摄像头,或仅用激光雷达进行高斯初始化或深度监督,未能充分利用点云中的丰富信息(如反射率)以及激光雷达与RGB之间的互补性,导致在高自车运动和复杂光照等挑战性场景中性能下降。为此,我们提出一种鲁棒高效的激光雷达-反射率引导高亮高斯溅射方法(LR-SGS),引入结构感知的高亮高斯表示,从激光雷达提取的几何与反射率特征点初始化,并通过显著性变换与改进密度控制以捕捉边缘和平面结构。此外,我们将激光雷达强度校准为反射率并作为无光照依赖的材质通道附加至每个高斯点,与RGB联合对齐以强制边界一致性。在Waymo Open Dataset上的大量实验表明,LR-SGS以更少高斯点和更短训练时间实现更优重建性能;尤其在复杂光照场景下,相比OmniRe提升1.18 dB PSNR。
原文摘要 · Abstract (English)
Recent 3D Gaussian Splatting (3DGS) methods have demonstrated the feasibility of self-driving scene reconstruction and novel view synthesis. However, most existing methods either rely solely on cameras or use LiDAR only for Gaussian initialization or depth supervision, while the rich scene information contained in point clouds, such as reflectance, and the complementarity between LiDAR and RGB have not been fully exploited, leading to degradation in challenging self-driving scenes, such as those with high ego-motion and complex lighting. To address these issues, we propose a robust and efficient LiDAR-reflectance-guided Salient Gaussian Splatting method (LR-SGS) for self-driving scenes, which introduces a structure-aware Salient Gaussian representation, initialized from geometric and reflectance feature points extracted from LiDAR and refined through a salient transform and improved density control to capture edge and planar structures. Furthermore, we calibrate LiDAR intensity into reflectance and attach it to each Gaussian as a lighting-invariant material channel, jointly aligned with RGB to enforce boundary consistency. Extensive experiments on the Waymo Open Dataset demonstrate that LR-SGS achieves superior reconstruction performance with fewer Gaussians and shorter training time. In particular, on Complex Lighting scenes, our method surpasses OmniRe by 1.18 dB PSNR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。