arXiv:2503.08317cs.ROcs.NI2025-03被引 3

用高斯点统一模拟摄像头与激光雷达,提升自动驾驶仿真效率与精度。

Uni-Gaussians: Unifying Camera and Lidar Simulation with Gaussians for Dynamic Driving Scenarios

  • 结合光栅化与高斯射线追踪,分别处理图像和激光雷达数据。
  • 在公开数据集上渲染速度更快,且图像与点云质量优于现有方法。
  • 适合需要高保真多传感器仿真的自动驾驶研发人员使用。

确保自动驾驶安全需在多种动态驾驶场景中全面仿真多传感器数据,涵盖摄像头与激光雷达输入。神经渲染技术利用采集的原始传感器数据模拟动态环境,已成为主流方法。虽然基于NeRF的方法能统一表示场景以生成相机和激光雷达数据,但因密集采样导致渲染速度慢;而基于高斯点阵列的方法通过光栅化实现快速渲染,却难以准确建模非线性光学传感器,限制其在针孔相机以外传感器的应用。为此,本文提出一种新混合方法:对图像数据采用光栅化渲染,对激光雷达数据采用高斯射线追踪。在公开数据集上的实验表明,该方法优于当前最先进水平。本工作实现了基于高斯原语的统一、高效的真实感仿真,显著提升了渲染质量与计算效率。

原文摘要 · Abstract (English)

Ensuring the safety of autonomous vehicles necessitates comprehensive simulation of multi-sensor data, encompassing inputs from both cameras and LiDAR sensors, across various dynamic driving scenarios. Neural rendering techniques, which utilize collected raw sensor data to simulate these dynamic environments, have emerged as a leading methodology. While NeRF-based approaches can uniformly represent scenes for rendering data from both camera and LiDAR, they are hindered by slow rendering speeds due to dense sampling. Conversely, Gaussian Splatting-based methods employ Gaussian primitives for scene representation and achieve rapid rendering through rasterization. However, these rasterization-based techniques struggle to accurately model non-linear optical sensors. This limitation restricts their applicability to sensors beyond pinhole cameras. To address these challenges and enable unified representation of dynamic driving scenarios using Gaussian primitives, this study proposes a novel hybrid approach. Our method utilizes rasterization for rendering image data while employing Gaussian ray-tracing for LiDAR data rendering. Experimental results on public datasets demonstrate that our approach outperforms current state-of-the-art methods. This work presents a unified and efficient solution for realistic simulation of camera and LiDAR data in autonomous driving scenarios using Gaussian primitives, offering significant advancements in both rendering quality and computational efficiency.

自动驾驶多传感器仿真高斯点阵列渲染效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。