arXiv:2603.17714cs.AI2026-03中稿 · manuscript - Trans…被引 1

综述仿真与合成数据如何推动自动驾驶从虚拟走向真实世界落地

From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving

  • 用虚拟环境生成可控、带标注的海量训练数据
  • 提出数字孪生和域适应策略提升系统泛化能力
  • 适合关注自动驾驶仿真与真实部署的研究者

近年来,自动驾驶技术取得显著进展,但其在现实世界的部署仍受限于数据稀缺、安全要求及跨环境泛化需求。为此,合成数据与虚拟环境成为关键支撑,可提供可扩展、可控且丰富标注的场景用于训练与评估。本文全面综述了自动驾驶、仿真技术与合成数据集交叉领域的最新进展,从三个核心维度展开:(i) 合成数据在感知与规划中的应用;(ii) 基于数字孪生的系统验证仿真;(iii) 融合合成与真实数据的域适应策略。同时探讨视觉语言模型与仿真真实度对场景理解与泛化能力的提升作用。文中详细分类了数据集、工具与仿真平台,并分析基准设计趋势。最后讨论了关键挑战与开放方向,包括Sim2Real迁移、可扩展安全验证、协同自动驾驶与仿真驱动的策略学习,这些是实现安全、泛化且全球可部署自动驾驶系统必须突破的问题。

原文摘要 · Abstract (English)

Autonomous driving technologies have achieved significant advances in recent years, yet their real-world deployment remains constrained by data scarcity, safety requirements, and the need for generalization across diverse environments. In response, synthetic data and virtual environments have emerged as powerful enablers, offering scalable, controllable, and richly annotated scenarios for training and evaluation. This survey presents a comprehensive review of recent developments at the intersection of autonomous driving, simulation technologies, and synthetic datasets. We organize the landscape across three core dimensions: (i) the use of synthetic data for perception and planning, (ii) digital twin-based simulation for system validation, and (iii) domain adaptation strategies bridging synthetic and real-world data. We also highlight the role of vision-language models and simulation realism in enhancing scene understanding and generalization. A detailed taxonomy of datasets, tools, and simulation platforms is provided, alongside an analysis of trends in benchmark design. Finally, we discuss critical challenges and open research directions, including Sim2Real transfer, scalable safety validation, cooperative autonomy, and simulation-driven policy learning, that must be addressed to accelerate the path toward safe, generalizable, and globally deployable autonomous driving systems.

自动驾驶仿真合成数据数字孪生

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。