评估3D高斯溅射在自动驾驶场景重建中的表现,助力安全测试
From Concept to Capability: Evaluating 3D Gaussian Splatting for Synthetic Scene Editing in Autonomous Driving

- 用多视角图像和激光雷达数据重建动态交通场景
- 发现车辆与行人重建质量在新视角下明显下降
- 为自动驾驶系统开发提供真实场景生成的可靠性参考
自动驾驶系统(ADS)的感知能力依赖于相关、全面且多样化的数据集以确保运行安全。实际道路数据收集难以覆盖所有罕见但可能引发安全事故的场景,这给ADS的开发、验证与确认带来挑战。3D高斯溅射(3DGS)在基于摄像头与激光雷达数据的场景重建与编辑方面展现出潜力,但其在工业级应用中对重建保真度的评估仍不充分,尤其在自动驾驶这类安全关键系统中尤为重要。由于自动驾驶系统运行于动态、非受控环境,视角有限且常存在遮挡,该问题更为突出。本文提出并实现一个系统性框架(图1),用于分析3DGS在重建安全相关场景中的能力与局限性,重点关注车辆与行人这两类对自动驾驶至关重要的对象。研究结果揭示了从多角度(横向与纵向)观察时重建保真度的退化规律,为将此类方法集成到真实的自动驾驶软件开发与测试流程中提供了行业洞见。
原文摘要 · Abstract (English)
The perception of an Autonomous Driving System (ADS) critically depends on relevant, comprehensive, and diverse datasets to ensure its safety while operating in the environment. Field data collection lacks completeness with respect to the list of rare but still possible safety-related scenarios needed for the development, verification, and validation of the ADS. 3D Gaussian Splatting (3DGS) has shown promising capabilities for the reconstruction and editing of scenes based on data collected by cameras and LiDAR sensors. However, the industrial fidelity evaluation of reconstructions is underexplored, which is crucial when employing such methods in safety-related systems, especially for ADS. This becomes more challenging as ADS operates in a dynamic, uncontrolled environment with limited viewpoints and often partially occluded objects. This paper addresses this gap by proposing and implementing a framework (Fig. 1) to systematically analyze the capabilities and limitations of 3DGS for use in the reconstruction of safety-related scenes. It focuses on the quality of reconstruction for vehicles and pedestrians, which are the two most critical object classes for ADS. Our findings provide industry insights into the fidelity degradation of reconstructions from multiple novel viewpoints, both lateral and longitudinal, enabling the integration of these methods into real-world industrial AD software development and testing pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。