提出新方法量化真实与仿真点云差距,助力自动驾驶安全测试
Mind the Domain Gap: Measuring the Domain Gap Between Real-World and Synthetic Point Clouds for Automated Driving Development
- 设计新指标DoGSS-PCL,从几何与语义双维度评估仿真点云质量
- 实验发现合成数据在50:50真实/仿真比例下仍可保持模型性能
- 适用于自动驾驶场景的可信仿真研究与数字孪生系统构建
由于典型长尾数据分布问题,生成无领域差异的仿真数据在机器人、摄影测量和计算机视觉研究中至关重要。其核心挑战在于可信地衡量真实数据与仿真数据之间的差异。这一度量对自动驾驶等安全关键应用尤为重要,因为域外样本可能影响车辆感知并引发致命事故。以往工作多在单一场景模拟数据,并在另一真实场景分析性能,导致对网络缺陷、类别定义与物体表征带来的领域差距分析割裂。本文提出一种新方法,用于衡量同一位置的真实传感器观测与仿真数据间的领域差距,实现全面的领域差距分析。为此,我们引入新指标DoGSS-PCL及评估框架,用于评估仿真点云的几何与语义质量。实验验证了该方法的有效性,并发现合成语义点云可用于深度神经网络训练,在50:50真实/仿真比例下仍能维持模型性能。我们认为本工作将推动可信数据仿真的研究,支持自动驾驶测试与数字孪生的大规模部署。
原文摘要 · Abstract (English)
Owing to the typical long-tail data distribution issues, simulating domain-gap-free synthetic data is crucial in robotics, photogrammetry, and computer vision research. The fundamental challenge pertains to credibly measuring the difference between real and simulated data. Such a measure is vital for safety-critical applications, such as automated driving, where out-of-domain samples may impact a car's perception and cause fatal accidents. Previous work has commonly focused on simulating data on one scene and analyzing performance on a different, real-world scene, hampering the disjoint analysis of domain gap coming from networks' deficiencies, class definitions, and object representation. In this paper, we propose a novel approach to measuring the domain gap between the real world sensor observations and simulated data representing the same location, enabling comprehensive domain gap analysis. To measure such a domain gap, we introduce a novel metric DoGSS-PCL and evaluation assessing the geometric and semantic quality of the simulated point cloud. Our experiments corroborate that the introduced approach can be used to measure the domain gap. The tests also reveal that synthetic semantic point clouds may be used for training deep neural networks, maintaining the performance at the 50/50 real-to-synthetic ratio. We strongly believe that this work will facilitate research on credible data simulation and allow for at-scale deployment in automated driving testing and digital twinning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。