用高保真数字孪生缩小仿真与真实感知差距,提升自动驾驶感知性能。
High-Fidelity Digital Twins for Bridging the Sim2Real Gap in LiDAR-Based ITS Perception
- 构建融合真实道路几何与传感器特性的高保真数字孪生环境。
- 模型在真实数据上比传统实拍训练提升4.8%准确率。
- 适合自动驾驶、智能交通系统感知研究者参考。
Sim2Real领域迁移为智能交通系统(ITS)中基于激光雷达的感知(如目标检测、跟踪、分割)提供了低成本且可扩展的方案。然而,由于分布偏移,仿真训练的感知模型在真实数据上表现往往不佳。为此,本文提出高保真数字孪生(HiFi DT)框架,整合真实背景几何、车道级道路拓扑及传感器特定参数与布局。我们形式化了Sim2Real学习背后的域适应挑战,并提出系统化方法构建生成域内合成数据的仿真环境。使用现成3D目标检测器在HiFi DT生成的合成数据上训练,并在真实数据上评估。实验表明,该模型在真实数据上性能优于同等规模实拍数据训练的模型4.8%。通过多种度量(含Chamfer Distance、MMD、EMD、Fréchet Distance)在原始输入和特征层面量化合成与真实数据的分布对齐程度,结果表明HiFi DT显著降低了域偏移,提升了多样场景下的泛化能力。这些发现凸显了数字孪生在实现可靠仿真驱动的激光雷达感知中的关键作用。
原文摘要 · Abstract (English)
Sim2Real domain transfer offers a cost-effective and scalable approach for developing LiDAR-based perception (e.g., object detection, tracking, segmentation) in Intelligent Transportation Systems (ITS). However, perception models trained in simulation often under perform on real-world data due to distributional shifts. To address this Sim2Real gap, this paper proposes a high-fidelity digital twin (HiFi DT) framework that incorporates real-world background geometry, lane-level road topology, and sensor-specific specifications and placement. We formalize the domain adaptation challenge underlying Sim2Real learning and present a systematic method for constructing simulation environments that yield in-domain synthetic data. An off-the-shelf 3D object detector is trained on HiFi DT-generated synthetic data and evaluated on real data. Our experiments show that the DT-trained model outperforms the equivalent model trained on real data by 4.8%. To understand this gain, we quantify distributional alignment between synthetic and real data using multiple metrics, including Chamfer Distance (CD), Maximum Mean Discrepancy (MMD), Earth Mover's Distance (EMD), and Fr'echet Distance (FD), at both raw-input and latent-feature levels. Results demonstrate that HiFi DTs substantially reduce domain shift and improve generalization across diverse evaluation scenarios. These findings underscore the significant role of digital twins in enabling reliable, simulation-based LiDAR perception for real-world ITS applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。