arXiv:2510.12901cs.CVcs.GR2025-10被引 4

实时同步生成激光雷达与任意相机模型数据,精度提升40%。

SimULi: Real-Time LiDAR and Camera Simulation with Unscented Transforms

  • 用无迹变换扩展3DGUT,支持任意畸变镜头与旋转激光雷达
  • 跨传感器一致性优化使相机与深度误差降低最多40%
  • 比传统方法快10-20倍,适用于自动驾驶高保真测试

自动驾驶等自主机器人系统的安全验证依赖于高保真仿真环境,以覆盖真实世界中难以采集或无法穷尽的场景。现有基于NeRF和3DGS的神经渲染方法虽有潜力,但存在渲染速度慢或仅支持针孔相机模型的问题,难以满足常需大畸变镜头和激光雷达数据的应用需求。多传感器仿真还面临模态间不一致的挑战,现有方法往往牺牲某一模态质量来提升另一模态。为此,我们提出SimULi,首个可实时渲染任意相机模型与激光雷达数据的方法。该方法在原生支持复杂相机模型的3DGUT基础上,通过自动分块策略与基于射线的剔除机制,首次实现对任意旋转激光雷达模型的支持。为解决跨传感器不一致性问题,设计了分解式3D高斯表示与锚定策略,使相机与深度均方误差相比现有方法最多降低40%。SimULi渲染速度较光线追踪方法快10-20倍,较先前基于光栅化的方案快1.5-10倍,且支持更广泛的相机模型。在两个主流自动驾驶数据集上的评估显示,SimULi在多个相机与激光雷达指标上达到或超过现有最先进水平。

原文摘要 · Abstract (English)

Rigorous testing of autonomous robots, such as self-driving vehicles, is essential to ensure their safety in real-world deployments. This requires building high-fidelity simulators to test scenarios beyond those that can be safely or exhaustively collected in the real-world. Existing neural rendering methods based on NeRF and 3DGS hold promise but suffer from low rendering speeds or can only render pinhole camera models, hindering their suitability to applications that commonly require high-distortion lenses and LiDAR data. Multi-sensor simulation poses additional challenges as existing methods handle cross-sensor inconsistencies by favoring the quality of one modality at the expense of others. To overcome these limitations, we propose SimULi, the first method capable of rendering arbitrary camera models and LiDAR data in real-time. Our method extends 3DGUT, which natively supports complex camera models, with LiDAR support, via an automated tiling strategy for arbitrary spinning LiDAR models and ray-based culling. To address cross-sensor inconsistencies, we design a factorized 3D Gaussian representation and anchoring strategy that reduces mean camera and depth error by up to 40% compared to existing methods. SimULi renders 10-20x faster than ray tracing approaches and 1.5-10x faster than prior rasterization-based work (and handles a wider range of camera models). When evaluated on two widely benchmarked autonomous driving datasets, SimULi matches or exceeds the fidelity of existing state-of-the-art methods across numerous camera and LiDAR metrics.

激光雷达仿真多模态感知实时渲染自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。