arXiv:2509.22379cs.SEcs.RO2025-09被引 5

对比四种测试方式,揭示自动驾驶仿真与现实的差距。

A Multi-Modality Evaluation of the Reality Gap in Autonomous Driving Systems

  • 用实车与数字孪生对比四种测试模式,评估真实感差异。
  • 混合现实测试在感知真实度上最优,且不影响安全控制。
  • 发现故障不传递的条件,定位关键差距维度。

基于仿真的测试是自动驾驶系统(ADS)开发的核心,能在多样驾驶场景中实现安全、可扩展的评估。然而,仿真与现实行为之间的差异——即“现实差距”——影响了测试结果向部署系统的可迁移性。本文通过一个配备真实传感器(摄像头与激光雷达)的小型实车及其数字孪生,系统比较了四种典型测试模态:软件在环(SiL)、车辆在环(ViL)、混合现实(MR)和全实景测试。在包含真实障碍物、道路拓扑与室内环境的多样化场景下,评估了两种ADS架构(模块化与端到端)。从执行、感知和行为三方面系统分析各模态的现实差距。结果表明,尽管SiL与ViL简化了真实动态与感知特性,但MR测试显著提升了感知真实性,同时保持安全与控制性能。更重要的是,我们识别出故障不跨模态转移的条件,并确定造成差异的关键维度。研究为不同测试方式的优劣提供了可操作洞察,指明了提升自动驾驶系统验证鲁棒性与可迁移性的路径。

原文摘要 · Abstract (English)

Simulation-based testing is a cornerstone of Autonomous Driving System (ADS) development, offering safe and scalable evaluation across diverse driving scenarios. However, discrepancies between simulated and real-world behavior, known as the reality gap, challenge the transferability of test results to deployed systems. In this paper, we present a comprehensive empirical study comparing four representative testing modalities: Software-in-the-Loop (SiL), Vehicle-in-the-Loop (ViL), Mixed-Reality (MR), and full real-world testing. Using a small-scale physical vehicle equipped with real sensors (camera and LiDAR) and its digital twin, we implement each setup and evaluate two ADS architectures (modular and end-to-end) across diverse indoor driving scenarios involving real obstacles, road topologies, and indoor environments. We systematically assess the impact of each testing modality along three dimensions of the reality gap: actuation, perception, and behavioral fidelity. Our results show that while SiL and ViL setups simplify critical aspects of real-world dynamics and sensing, MR testing improves perceptual realism without compromising safety or control. Importantly, we identify the conditions under which failures do not transfer across testing modalities and isolate the underlying dimensions of the gap responsible for these discrepancies. Our findings offer actionable insights into the respective strengths and limitations of each modality and outline a path toward more robust and transferable validation of autonomous driving systems.

自动驾驶仿真测试现实差距

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。