用伪激光雷达监督提升3D高斯溅射在未知路径上的仿真能力
LiDAR-EVS: Enhance Extrapolated View Synthesis for 3D Gaussian Splatting with Pseudo-LiDAR Supervision
- 通过多帧融合与视角变换生成伪外推点云作监督信号
- 在三个数据集上达到当前最佳外推视图激光雷达合成效果
- 无需多遍数据,适合真实驾驶场景的闭环评估与数据生成
3D高斯溅射(3DGS)已成为自动驾驶仿真中实时激光雷达与相机合成的强大技术。然而,现有方法在训练轨迹之外的外推视图上仍难以可靠模拟激光雷达数据,因其通常基于单次行驶扫描训练,存在严重过拟合且泛化能力差。为在无外部多遍数据情况下实现对未见行驶路径的可靠激光雷达仿真,我们提出LiDAR-EVS——一种轻量级、可即插即用的外推视图激光雷达仿真框架,适用于多种激光雷达传感器与神经渲染基线。其核心包括:(1) 多帧激光雷达融合生成伪外推视图点云,含视角变换、遮挡修正与强度调整;(2) 空间约束丢弃正则化,增强对真实驾驶中多样化轨迹变化的鲁棒性。大量实验表明,该方法在三个数据集上均达到当前最优性能,是数据驱动仿真、闭环评估与合成数据生成的有力工具。
原文摘要 · Abstract (English)
3D Gaussian Splatting (3DGS) has emerged as a powerful technique for real-time LiDAR and camera synthesis in autonomous driving simulation. However, simulating LiDAR with 3DGS remains challenging for extrapolated views beyond the training trajectory, as existing methods are typically trained on single-traversal sensor scans, suffer from severe overfitting and poor generalization to novel ego-vehicle paths. To enable reliable simulation of LiDAR along unseen driving trajectories without external multi-pass data, we present LiDAR-EVS, a lightweight framework for robust extrapolated-view LiDAR simulation in autonomous driving. Designed to be plug-and-play, LiDAR-EVS readily extends to diverse LiDAR sensors and neural rendering baselines with minimal modification. Our framework comprises two key components: (1) pseudo extrapolated-view point cloud supervision with multi-frame LiDAR fusion, view transformation, occlusion curling, and intensity adjustment; (2) spatially-constrained dropout regularization that promotes robustness to diverse trajectory variations encountered in real-world driving. Extensive experiments demonstrate that LiDAR-EVS achieves SOTA performance on extrapolated-view LiDAR synthesis across three datasets, making it a promising tool for data-driven simulation, closed-loop evaluation, and synthetic data generation in autonomous driving systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。