arXiv:2412.18380cs.CVcs.GR2024-12中稿 · publication in [IS…被引 9

用激光雷达约束3D高斯点云,提升航拍场景新视角合成精度

ARSGaussian: 3D Gaussian Splatting with LiDAR for Aerial Remote Sensing Novel View Synthesis

  • 融合激光雷达点云指导高斯点生长与分裂,解决几何误差导致的浮点和过度膨胀问题
  • 引入深度、法向与尺度一致性损失,使重建更贴近真实地形与表面结构
  • 构建并开源8点/平方米密度的航拍多源数据集AIR-LONGYAN,推动领域发展

新视角合成(NVS)可从多视角图像重建场景并生成新视角图像,为目标识别与环境感知提供支持。航拍遥感可通过少量飞行获取丰富多视角图像,但因距离远、视角稀疏,常导致模型产生浮点和过生长现象,造成视觉质量差与几何估计不准。为此,本文提出ARSGaussian,将激光雷达点云作为约束融入3D高斯点阵方法,自适应引导高斯点沿几何基准生长与分裂,有效缓解过生长与浮点问题。同时,针对数据采集引起的几何畸变,采用含畸变参数的坐标变换替代简单针孔相机模型,实现激光雷达点云与多视角光学图像在像素级对齐,促进异源数据精准融合与高精度地理对齐。此外,引入深度、法向与尺度一致性正则化损失,引导高斯点逼近真实深度与平面结构,显著提升几何估计精度。为弥补现有密集空载混合数据集不足,本研究构建并发布开放数据集AIR-LONGYAN,包含8点/平方米密度的密集激光雷达点云及多种场景下航空扫描器与相机采集的多视角光学图像。

原文摘要 · Abstract (English)

Novel View Synthesis (NVS) can reconstruct scenes from multi-view images and synthesize novel images from new viewpoints, which provides technical support for tasks such as target recognition and environmental perception. Aerial remote sensing can conveniently capture a wealth of multi-view images with just a few flights. However, the challenges brought by large distances and sparse viewing angles during collection can cause the model to easily produce floaters and overgrowth issues due to geometric estimation errors. This results in low visual quality and a lack of precise geometric estimation capabilities. Therefore, this study presents ARSGaussian, an innovative novel view synthesis (NVS) method for aerial remote sensing. The method incorporates LiDAR point cloud as constraints into the 3D Gaussian Splatting approach, adaptively guiding the Gaussians to grow and split along geometric benchmarks, thereby addressing the overgrowth and floaters issues. Additionally, considering the geometric distortions arising from data acquisition, coordinate transformations with distortion parameters are integrated to replace the simple pinhole camera model parameters to achieve pixel-level alignment between LiDAR point cloud and multi-view optical images, facilitating the accurate fusion of heterogeneous data and achieving the high-precision geo-alignment. Moreover, depth, normal and scale consistency losses are introduced into the regularization process to guide Gaussians toward real depth and plane representations, significantly improving geometric estimation accuracy. To address the current lack of dense airborne hybrid datasets, we have established and released AIR-LONGYAN, an open-source dataset containing a dense LiDAR point cloud (8 pts/m) and multi-view optical images captured by airborne scanners and cameras in diverse scenes....

3D重建航拍遥感高斯溅射激光雷达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。