用高斯点云实时重建激光雷达扫描,精度与速度均领先
LiDAR-GS:Real-time LiDAR Re-Simulation using Gaussian Splatting
- 通过可微分激光束投射实现精确表面渲染
- 支持深度、强度、丢射三通道同步重仿真
- 适合自动驾驶仿真与传感器算法测试
我们提出 LiDAR-GS,一种基于高斯点云(Gaussian Splatting, GS)的实时高保真激光雷达扫描重仿真方法,适用于公开的城市道路场景。尽管最近的GS方法在相机渲染上已超越神经辐射场(NeRF),但将其应用于主动三维传感器激光雷达仍面临诸多挑战,需保持高精度与独特特性。LiDAR-GS设计了可微分的激光束点阵投射,采用范围视图表示,将激光投影至微小横截面以实现精准表面点阵化,有效消除局部仿射近似带来的伪影。此外,通过神经高斯表示融合视角依赖线索,捕捉受入射方向和外部因素影响的激光雷达关键属性。结合动态实例分解等必要改进,LiDAR-GS能同时重仿真深度、强度与射线丢失通道,在公开大型场景数据集上实现领先的渲染帧率与质量,优于使用显式网格或隐式NeRF的方法。代码已开源。
原文摘要 · Abstract (English)
We present LiDAR-GS, a Gaussian Splatting (GS) method for real-time, high-fidelity re-simulation of LiDAR scans in public urban road scenes. Recent GS methods proposed for cameras have achieved significant advancements in real-time rendering beyond Neural Radiance Fields (NeRF). However, applying GS representation to LiDAR, an active 3D sensor type, poses several challenges that must be addressed to preserve high accuracy and unique characteristics. Specifically, LiDAR-GS designs a differentiable laser beam splatting, using range-view representation for precise surface splatting by projecting lasers onto micro cross-sections, effectively eliminating artifacts associated with local affine approximations. Furthermore, LiDAR-GS leverages Neural Gaussian Representation, which further integrate view-dependent clues, to represent key LiDAR properties that are influenced by the incident direction and external factors. Combining these practices with some essential adaptations, e.g., dynamic instances decomposition, LiDAR-GS succeeds in simultaneously re-simulating depth, intensity, and ray-drop channels, achieving state-of-the-art results in both rendering frame rate and quality on publically available large scene datasets when compared with the methods using explicit mesh or implicit NeRF. Our source code is publicly available at https://www.github.com/cqf7419/LiDAR-GS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。